collaborative filtering, recommendation engine

neo4j tutorial on recommendation engine

random search libraries

spotify randomizer

heuristic search libraries

twitch chat scraper and meme prediction heuristic

how to find trending topics or videos?

you can check the same set of video and plot their historical stats, or use official ‘trending’ api to find out.

find ‘random’ videos of certain topic:

search for playlists, collect recommendations

apply to some video feeding apis or official api like giphy

heuristic search, graph search intro

use heuristic recursive search, apply random parameters, find related keywords, apply filters and update weights

topic modeling using gensim

bertopic tutorial can predict topics of new document and get topic similarity

1
2

pip3 install bertopic

可以事先设定好目标 不管这个搜没搜到 都要奖励搜索成功的那次过程 比如老头环和elden ring的对应关系

有没有相关的工具？名字是什么？

recursive text search engine

Heuristic Text Search Engine

free pdf: Heuristic and Systematic Use of Search Engines

it’s like webgpt, which has arxiv pdf paper

openai alignment research is to make artificial general intelligence (AGI) aligned with human values and follow human intent.

there’s also a fake news detector inside web browser

搜索一个词 拿到感兴趣的继续搜下一个

把你搜索的过程记录下来 搜集信息寻找关联的过程记录下来 然后交给ai进行离线训练

同时可以把你创建内容 组织结构的过程记录下来 交给ai离线训练 适用于[template based content generator](./pyjom schedules.md)

这个人的空间链接目前可以访问@2022 september 4

可以在被拉黑了之后快速点击右上角的分享链接 分享到其他人 其他群里面 或者点击生成链接 即可在浏览器里面查看这个人的动态 但是不知道这个链接有没有时效性 现在看起来就是一堆乱码 app里面的分享也不知道有没有时效性

不知道能不能搜索或者遍历 如果不能的话只能黑进去了 不过那样的话出来的数据肯定更多

要知道被拉黑，本地肯定有用户的ID， 有了ID就可以拿过去到其他新注册的Soul账号上面使用 通过底层api访问

可以考虑用Frida或者网上的一些脚本来分析破解SoulAPP 单独使用Frida估计不能利用Python遍历 还是需要破解协议证书才可以自由访问

frida usage, code examples for windows

radare2 tutorial with code

original youtube-dl

the fork with faster (maybe?) download speed: yt-dlp

twitch

https://netflix.com

https://www.ted.com

https://www.youtube.com

https://www.instagram.com

https://twitter.com

https://www.pornhub.com

https://www.bilibili.com

https://www.douyu.com

https://www.huya.com

https://www.iqiyi.com

https://www.youku.com

https://weibo.com/tv

https://krcom.cn

https://tv.sohu.com

https://v.qq.com

NetEase Public Class

[QQ Music-MV](QQ Music-MV)

• 看看别人的数据来源是什么

知乎神回答 知乎同类回答 排行榜 github排行榜 同类内容

比较视频可以用段落总结关键词来做

free open source animation software for linux, by sourceforge.net

three.js javascript 3d library

typed.js imitate typing animation

anime.js javascript animation engine

synfig 2d vector based animation library

countup.js animate counting up to a number

vivus.js drawing animation imitator

Libreoffice Impress或者其他的动画工具 制作视频 比如synfig blender three.js

https://ask.libreoffice.org/t/convert-impress-presentation-to-video/33952

https://ask.libreoffice.org/t/how-to-turn-libreoffice-impress-into-video-mp4-format/20589

同样的 可以制作冷知识问答的动画视频 通过收集百度 bing搜索相关词语 如果是问句 问题 就拿来搜索 如果出现了放大版本的句子就收集下来 就是回答

zhihuq query zhihu articles by keywords and relevance

b站前100视频爬取

b站爬取首页热门推荐视频

爬取b站弹幕

trending scraper for bilibili, baidu, zhihu, weibo

基于node.js的抓取微博、百度热搜、知乎日报、bilibili等热榜榜爬虫 热搜

trending reddit videos scraper and video uploader for youtube with special transition effects

news search engine 新闻搜索

通过百度 微视（腾讯小视频）是可以搜索的

image search engines sourced from search by image browser plugin:

Google, Bing, Yandex, Baidu and TinEye

google tts for python:

import gtts

爬取课程视频 去水印

coursera udemy khanacademy icourse163

爬取tumblr 知乎 腾讯新闻

https://github.com/zhangslob/awesome_crawl

图片下载api

https://github.com/CharlesPikachu/imagedl

免费聊天api 青云客api 腾讯智能闲聊

https://zhuanlan.zhihu.com/p/110785806

http://api.qingyunke.com/api.php?key=free&appid=0&msg=你好

思知对话机器人 语义理解 自然语言转化为结构化数据

https://www.ownthink.com/docs/bot/

https://github.com/ownthink/robot/

流行视频下载api

https://github.com/CharlesPikachu/videodl

热搜

https://github.com/Eurkon/weibo-top-api

https://github.com/ningyuwhut/query_suggestion

https://github.com/Arrackisarookie/weibo-hot-search

https://github.com/justjavac/zhihu-trending-top-search

https://github.com/justjavac/weibo-trending-hot-search

https://github.com/huqi-pr/trending-in-one

https://github.com/jw-star/weiboPush-go-actions

热搜2

https://github.com/wanghuafeng/baidu_spider

https://github.com/TauWu/weibo_daily_hotkey

https://github.com/quarrying/baidu-top-crawler

https://github.com/towelong/zhihu-hot-questions

https://github.com/gaussic/baidu_hot_words

https://github.com/ctts/TopSearch

https://github.com/henrylee123/baiduIndexCrawler

https://github.com/realzhengyiming/Spider_of_keywordRank

登录主流网站

https://github.com/CharlesPikachu/DecryptLogin

微博热搜

https://github.com/Eurkon/weibo-top-api

微博 python api

https://pypi.org/project/weibo/

github actions抓取微博热搜

https://github.com/xiadd/tg-wb-trending

百度搜索api

https://github.com/wcadaydayup/python-baidusearch

https://github.com/1049451037/MagicBaidu

https://github.com/alkalixin/jsonp

微软小冰api

https://github.com/yanwii/msxiaoiceapi

https://github.com/BennyThink/realXiaoice

搜狗微信

https://github.com/chyroc/WechatSogou

https://github.com/jaryee/wechat_sogou_crawlhttps://github.com/pujinxiao/weixin

知乎爬虫

https://github.com/LiuRoy/zhihu_spider

搜索引擎爬虫 图片下载

https://github.com/tasos-py/Search-Engines-Scraper

https://github.com/ostrolucky/Bulk-Bing-Image-downloader

https://github.com/NikolaiT/GoogleScraper

https://github.com/naqushab/SearchEngineScrapy

Soul APIs

soul绕过ssl双向验证 justTRUSTME(xposed)加上反编译SDK获取证书密码 backup blog

use adb to setup mitmproxy on android

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21

cd ~/Library/Android/sdk/platform-tools/
# Get the hash of the mitmproxy-ca certificate.
openssl x509 -inform PEM -subject_hash_old -in ~/.mitmproxy/mitmproxy-ca.pem | head -1
# We will use this hash value, append '.0' (dot zero) and use this as the filename for the resulting Android certificate
cat ~/.mitmproxy/mitmproxy-ca.pem > c8750f0d.0
openssl x509 -inform PEM -text -in ~/.mitmproxy/mitmproxy-ca.pem -out /dev/null >> c8750f0d.0
# In an other terminal, we will start the emulator with writable /system volume
cd ~/Library/Android/sdk/emulator/
# In order to launch an available avd, we list them first.
./emulator -list-avds
./emulator -writable-system @Pixel_3a_XL_API_28
# We go back to the first terminal and we use adb tool to transfert the certificate
adb root
adb push c8750f0d.0 /storage/emulated/0/Download
# Then, we will mount the volume and get access to the shell
adb shell mount -o rw,remount /;
adb shell
# In the device Android shell, we will move the certificate inside the system partition in the folder '/system/etc/security/'
cp /storage/emulated/0/Download/c8750f0d.0 /system/etc/security/cacerts/
chmod 644 /system/etc/security/cacerts/c8750f0d.0

可能的系统设置

1
2
3
4
5
6
7

su -c settings list global | grep proxy
global_http_proxy_exclusion_list=
global_http_proxy_host=
global_http_proxy_port=0
global_proxy_pac_url=
http_proxy=:0

灵魂测试卡片信息，获取签名*

https://api.soulapp.cn/html/measureResult/info/v2?userIdEcpt=加密用户ID

用户头像和签名等信息*

https://api-h5.soulapp.cn/html/v2/user/info?userIdEcpt=加密用户ID

单条瞬间展开信息*

https://api-h5.soulapp.cn/html/v3/post/detail?postIdEcpt=加密瞬间ID

单条瞬间展开页面*

https://w3.soulapp-inc.cn/activity/#/web/topic/detail?postIdEcpt=加密瞬间ID

用户发布瞬间信息，只有最新的10条*

https://api-h5.soulapp.cn/html/v2/post/homepage?userIdEcpt=加密用户ID

用户发布瞬间页面，只有最新的10条*

https://w3.soulapp-inc.cn/activity/#/web/user?userIdEcpt=加密用户ID

获取热门瞬间，只有最新的30条*

https://api-h5.soulapp.cn/html/v2/post/hot?pageIndex=1（前3页）

获取标签的瞬间信息，只有最新的30条*

https://api-h5.soulapp.cn/html/v2/tag/post?tagIdEcpt=加密标签ID

获取标签的瞬间页面，只有最新的30条*

https://w3.soulapp-inc.cn/activity/#/web/tag?tagIdEcpt=加密标签ID

随机播放音频信息，随机几首*

https://api-h5.soulapp.cn/html/v2/post/orimusicList/recommend

设置超萌捏脸页面*

https://app.soulapp.cn/avator/#/avatar/create?sex=1&version=3.10.0

注销账号页面*

https://app.soulapp.cn/app/#/account

https://app.soulapp.cn/app/#/destroy

cookie not found on request event handler.

cookie can be obtained via context.cookies()

router

runoob coder jokes:

https://www.runoob.com/w3cnote_genre/joke/page/2

telegram channels for programmer jokes

全自动电影解说软件介绍 全自动短视频合成

自媒体自学网 新媒体运营 自动化运营 混剪：

https://www.zmtzxw.com

generate video from plain text using beatdetectorforgames:

https://github.com/FireFragment/video-generator

youtube reddit text to speech video generator:

https://github.com/HA6Bots/Automatic-Youtube-Reddit-Text-To-Speech-Video-Generator-and-Uploader

twitch clip compilation:

https://github.com/HA6Bots/Twitch-Clips-Compilation-Generator-TCCG-

slideshow video generator:

https://github.com/oknoorap/vidshow

best of twitch video generator:

https://github.com/BayoDev/Twitch-Best-Of-Gen

video generator by scraping reddit videos and comments:

https://github.com/charlypoirier/redditube

youtube video generation based on watson natural languahe understanding and google image search:

https://github.com/rhenriquea/ai-video-generator

tiktok video compilation based on custom filters:

https://github.com/HA6Bots/TikTok-Compilation-Video-Generator

12个搬运手法：

去水印 放大缩小 镜像 抽帧 加滤镜 加特效 调色 调速 转场 调整视频顺序 加画中画 其他视频元素

文案加字幕 朗读方案：

https://m.baidu.com/video/page?pd=video_page&nid=9603074179371472094&sign=5664314656417860263&word=自动合成视频&oword=自动合成视频&atn=index&frsrcid=4185&ext=%7B"jsy"%3A1%7D&top=%7B"sfhs"%3A1%2C"_hold"%3A2%7D&sl=4&fr0=A&fr1=A&ms=1&lid=12061699393737547668&referlid=12061699393737547668&frorder=6&_t=1653970095475

知乎方案，模板加图片，BGM，配音

文章自动生成视频，幕言 自动打轴（force alignment）：

https://zhuanlan.zhihu.com/p/218000255

https://www.muyanpeiyin.com/?zhihu

5种方式生成原创视频：

https://zhuanlan.zhihu.com/p/140075360?from_voters_page=true

https://zhuanlan.zhihu.com/p/119422109

https://m.baidu.com/video/page?pd=video_page&nid=11383613456893718608&sign=855254448776210471&word=AI全自动剪辑软件：2分钟自动合成一个影视解说视频，批量效率高&oword=自动合成视频&atn=index&frsrcid=5373&ext=%7B"jsy"%3A1%7D&top=%7B"sfhs"%3A1%2C"_hold"%3A2%7D&sl=4&fr0=A&fr1=C&title=AI全自动剪辑软件：2分钟自动合成一个影视解说视频，批量效率高&lid=12061699393737547668&ms=1&_t=1653971026899

模式一：单视频+文案

一个视频配一个文案，软件将自动把文案转化成字幕以及真人发音，把视频和字幕添加到视频上

此模式适合电影解说，新闻讲解等等

模式二：多视频+文案

多个视频会随机合成一个视频,然后把文案转化成字幕以及真人发音，把视频和字幕添加到视频上

此模式适合抖音带货等

模式三：多图片+文案

多个图片会随机合成一个视频,然后把文案转化成字幕以及真人发音，把视频和字幕添加到视频上

此模式适合大批量却又苦于找不到视频素材的情况

模式四：单视频混剪

适合抖音带货，或者搬运类的影视混剪

模式五：文字转语音

现在头条也出了音频的创作专区，应广大用户的需求，添加这个功能，将txt文件批量放入video目录即可。