Autonomous Machines & Society.

2022-04-29
Translators For Casual Usage

Translators/Paraphraser for casual usage

baidu translator (api) provided by paddlehub

baidu language detector (api)

text style transfer:

https://blog.csdn.net/qq_27590277/article/details/106991084

python google translate api:

pip install googletrans

google translate in php:

https://github.com/Stichoza/google-translate-php

paraphrase via rephrasing and reordering

pegasus paraphrase:

increase the num_beams and temperature

https://analyticsindiamag.com/how-to-paraphrase-text-using-pegasus-transformer/

https://www.thepythoncode.com/article/paraphrase-text-using-transformers-in-python

example paraphrase project using LSTM as decoder and encoder:

https://github.com/vsuthichai/paraphraser

paraphrase with t5:

https://github.com/Vamsi995/Paraphrase-Generator

paraphrase dataset:

https://github.com/Wys997/Chinese-Paraphrase-from-Quora

文本纠错

https://github.com/James4Ever0/pycorrector

数据增强 变换句子形式

https://yongzhuo.blog.csdn.net/article/details/89166307

https://github.com/zhanlaoban/eda_nlp_for_Chinese

calculate perplexity:

https://github.com/DUTANGx/Chinese-BERT-as-language-model

https://github.com/James4Ever0/nlp-fluency

https://zhuanlan.zhihu.com/p/265677864

https://github.com/mattzheng/py-kenlm-model

multi-purpose tool for chinese: 偏旁部首 情感分析

https://github.com/SeanLee97/xmnlp

敏感词过滤 语言检测 训练语料库

https://github.com/fighting41love/funNLP

paraphraser.io

multilingual paraphrase database:

paraphrase.org

simbert

https://www.zhihu.com/question/317540171

BERT:原始版本bertRoberta:哈工大开源的中文wwm roberta模型BERT-SQ:本人在百度知道相似句数据集(Sim-Query)上微调后的bert模型Roberta-SQ:同上BERT-Whitening: @苏剑林 最新博客中提出的白化模型。Roberta-Whitening:同上

https://yongzhuo.blog.csdn.net/article/details/89166307

language fluency test:

https://github.com/baojunshan/nlp-fluency

many paraphraser models for english are on huggingface, but few for chinese.

https://huggingface.co/lijingxin/mt5-for-zh-paraphrase

https://pypi.org/project/genienlp/

https://github.com/salesforce/decaNLP

parrot paraphraser with nlu engines for english:

https://github.com/PrithivirajDamodaran/Parrot_Paraphraser

sentence level paraphraser:

https://github.com/vsuthichai/paraphraser

document level paraphraser, with sentence rewriting and reordering(shuffle):

https://github.com/L-Zhe/CoRPG

https://pypi.org/project/lexsub/

https://github.com/hit-joseph/lexical-paraphrase-extraction

synonyms (python library)

you can also train a contextual search tool using fine-tuned repurposed paraphrase model.

https://pypi.org/project/nlp-text-search/

文言文

https://github.com/raynardj/yuan

粤语

https://huggingface.co/x-tech

huggingface有英语翻译到其他语言的模型 没有翻译成中文的模型

在线

https://github.com/nidhaloff/deep-translator

https://github.com/UlionTse/translators

translatepy

离线

https://huggingface.co/tasks/translation

https://huggingface.co/Helsinki-NLP/opus-mt-zh-en

https://github.com/argosopentech/argos-translate

libretranslate

https://github.com/Teuze/translate

https://github.com/xhlulu/dl-translate/

facebook/mbart-large-50-many-to-many-mmt

mbart50

m2m100

view under https://huggingface.co/tasks to see great models fitting exact needs.

Read More

2022-04-28
Gpt-2 Ram Requirements

do not plug the fanless gpu into the slot before testing the blower. if the wind comes out from the other side, you are good.


design a external cooling system for passive cooling GPUs like P40, M40.

installed by screws, powered by usb cabels, sealed by heat-resistant silicon gels

you should adapt for different fan sizes, so that different customers can select the best ones.

the fan can also be screw-free by attaching it to a 3 DOF robot hand.

you can use plastic and glue instead of screws.

elaborate the structure of the fan mount by using cardboards.

download existing fan mount designs as reference and design your own.

design something like:

1
2
3
4
5
_________________      fan mount bracket (slightly shorter than the gpu bracket)
| | | | /
| |_| |__ original pci-e bracket
|________________________ /

visit here for downloading free pci-e bracket designs.


服务器重量在25公斤以上 运输和搬运均需注意

服务器制造的热风需要用空调降温 或者需要有专门的通风管道

服务器的功耗是非常大的 服务器标配暴力风扇 虽然降温稳定性能很好 可以随时更换 但是噪音非常大 如果插上了不支持的显卡那么风扇会高速旋转 可能需要转接卡或者适配装置 待机功耗300w起步 而一般的台式机待机100w 如果加装了显卡那么功耗还会继续上升 同时满载的m1 ultra的mac studio功耗在140w-200w左右 相对比较节能

服务器需要标配灭火装置和烟雾报警装置

服务器需要放置在隔音机柜里面 专门的隔音机柜非常的贵 但是如果自己只买铁皮机柜加隔音棉那么会便宜一些 可能需要再加装一层外壳 透明的玻璃可能需要被更换成不透明的 同时改装之后需要留出专门的风道 风道内部塞管道隔音棉 风道出入口添加防尘网

to support multiple gpus, one must use pci-e extended cable. 128g per ram slot.

Dell r750 series, using dell riser card to connect gpu

https://github.com/hpcaitech/ColossalAI

for monsterious models, zero offload, pytorch loghtning, distributed training in pytorch, or deepspeed, fairscale, colossalai, Horovod is needed. no single gpu is able to hold gpt3-175B at once.

exporting to onnx:

https://huggingface.co/docs/transformers/serialization?highlight=onnx

lower model precision (quantization):

如果想要在GPU上操作,可以先使用torch.nn.export函数将模型转换成onnx格式,然后就可以放到TensorRT框架上inference了。(TensorRT目前不能直接解析Pytorch的网络模型,需要转换成onnx)

https://www.jianshu.com/p/cf83c877d71d

https://blog.csdn.net/zimiao552147572/article/details/105910915

https://pytorch.org/docs/stable/quantization.html

https://github.com/huggingface/transformers/issues/14839 (training gpt-j on colab)

使用torch.quantization.quantize_dynamic获得动态量化的模型

量化的网络层为所有的nn.Linear的权重,使其成为int8

quantized_model = torch.quantization.quantize_dynamic(

model, {torch.nn.Linear}, dtype=torch.qint8

)

打印动态量化后的BERT模型

print(quantized_model)

how to use huggingface trainer:

https://zhuanlan.zhihu.com/p/363670628

https://zhuanlan.zhihu.com/p/486938936

https://zhuanlan.zhihu.com/p/358525654

https://huggingface.co/docs/transformers/main_classes/deepspeed#custom-deepspeed-zero-inference

https://huggingface.co/docs/transformers/main_classes/deepspeed

zero offload requires sufficient RAM.

https://github.com/alibaba/EasyParallelLibrary

https://github.com/SeanNaren/minGPT/tree/stage3

https://github.com/prigoyal/pytorch_memonger/blob/master/tutorial/Checkpointing_for_PyTorch_models.ipynb

https://github.com/eladrich/pixel2style2pixel

https://github.com/EleutherAI/gpt-neox

https://www.eleuther.ai

training turing-nlg:

https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/

cited from deepspeed:

Extremely memory efficient: With just a single GPU, ZeRO-Offload of DeepSpeed can train models with over 10B parameters, 10x bigger than the state of the art, democratizing multi-billion-parameter model training such that many deep learning scientists can explore bigger and better models.

need p40/m40 which has 24gb vram. need at least 60gb ram to load model.

using low ram devices need library like deepspeed, bminf or megengine.

you can also use others provided web services.

can use colab/kaggle or aistudio to do the job. paid training enviorment is also avaliable.

https://github.com/TsinghuaAI/CPM-1-Generate

https://github.com/arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram

https://pythonawesome.com/finetune-gpt2-xl-and-gpt-neo-on-a-single-gpu-with-huggingface-transformers-using-deepspeed

https://github.com/OpenBMB/BMInf

web api for chinese plug:

https://m.nlp.aliyun.com/mportal#/textGenerate

NVIDIA Tesla M40 24G 专业运算 英伟达 图形GPU加速深度学习显卡

提供魔改教程,需要一张亮机卡,用丽台K600当亮机卡就行,魔改后可用此卡打游戏

散热器可看图片,用3D打印散热风道,加上风扇就能用了

虚拟化 用这些卡 K1 K2 K340 K520(不需要授权) M60 P4 P10 P100 T4 RTX6000 RTX8000 V100 RTXA6000 P40 (需要授权)

虚拟化 VGPU 有两种模式 一种是VPC 适合普通办公 一种是VDWS 适合专业图形应用 然后P40两种模式都支持

购买之前先了解以下信息(您必须了解):

1、电源供电有没有8针供电;

2、普通台式机X99以上主板,DDR4内存;

3、主板要支持多显卡显示;

4、建议电源功率在600W以上;

5、机箱内的空间是否足够(卡宽双挡片位置,卡长度28~30cm)

6、普通台式机需要加装主动散热,服务器可以选择被动散热

7、先查看主板bios的pcie设置里面有没有above 4g选项

超微服务器原装拆机 成色超新 测试好发货

普通台式机上Tesla M40显卡paddleGPU深度学习柯南的变身器上机体验

最近在paddlepaddle溜达,看到了柯南变身器,于是从aistudio下载到本地玩,单位的1060 6G版显卡,跑起来,语句一场就不行,遂上淘宝,咸鱼溜达一圈,见到了tesla k80 m40等一系列的卡卡。于是经过多番考虑(知乎一位买k80说翻车的帖子),于是最终下手m40。咸鱼有卖1800的,我问他保一个月质保不,他说,不保,我说谢谢,我考虑一下,他骂***(这时代也不知道怎么了,我就发了两条消息,这货好像脑子有点问题了,随后拉黑。因此不建议上咸鱼买,毕竟想上m40卡的应当希望稳妥一点)。随后在淘宝找了一家1945包邮的,还送一条转接线。挺合适,单买电源转接线需要30左右。(其实我怀疑这两家是一家,因为都是上海的)。淘宝这个质保3个月。当个保险。我用的机器配置如下,都是王牌(快玩完了的)产品。附上大师截图。大师我们需要它,他是给我们装显卡驱动的。win10自己好像不太认。以下配置,绝对可以跑paddlepaddleGPU框架。除了U,别的都挺便宜,刚开始买来做NAS的奈何功耗太高40w了,搁置了,现在加上m40满血复活。整套下来5000千元。当然,内存大家没必要这么大。4千完全够。我这主要是普通台式机使用m40,大家完全可以用二手服务器。买完之后,我发现网上很多说m40这些系列必须专门的主板和u才能跑,所以,那心情大家都能猜到,已经做好,再买板子的准备的我。

正文

两天到货了,同时购买的电源,没有收到,买的600W电源,没办法,偏远小城市,快递缓慢。

建议大家 买大于600w的电源,我原本一台没有独显的机器用的是300W电源,随机迫于心急之情,开始剪线,改电源。

改电源线

我原本的电源提供一个常规的显卡供电口,是6+2=8的结构,3x12V 3xGND 2GND结构

而Tesla系列根据知乎朋友的介绍和,我的实际观察,确定其为一排4x12V 一排4xGND的结构,也就是和我的主板CPU供电一致。所以,知乎这位朋友说,他一开始用常规显卡接口供电,将他的k80干坏电容问题,估计很真实,也是这个前车之鉴,我小心对比了电源结构,最终开始剪掉了老板送电源线和我自己那个300W电源的12V显卡口,(其实一开始,准备只剪我自己这个电源的显卡口,改一下线路来着,奈何我这90块钱的电源,那线 细的就像头发丝 让我直接干断了)。接完线,我还发现我用的那个接口保护的热缩管,给小了,无奈,只能用电胶带缠绕。

Read More

2022-04-27
水冷散热注意

水里加醇类物质可以防止导电

软管加弹簧防止弯折

液体生料带 ergo 5500陶瓷胶 密封胶 液态密封圈 堵漏 用油管防止老化

用水管变径器来改变管径 先用相同大小软管连接目标接头 再用变径器链接变径软管

气压计 肥皂水测试是否漏水

水泵串联并联增加流量和扬程

多水道设计增加导热效率

显卡mos管需要水冷散热 建议看显卡发热红外图其他未水冷的地方贴上散热脊片

主板本来有热管 风扇散热的地方 例如南北桥 供电 如果要拆除 必须替换成水冷 背面也应该加上水冷

氟化液沉浸式散热 可以用潜水泵抽水加冷排

压缩机28度以上防止冷凝水聚集

用水冷弹性弹簧喉夹来链接软管 有快拧接口的要有快拧头连接硬管或软管

用热缩编织管来避免磨损 用阻燃波纹管套住最外面

打磨弹簧套管的两端 避免戳穿软管

用全开放式机架 铝合金框架 方便主板背面 显卡背面冷却装置的安装

工业装甲带缠绕接头部分

Read More

2022-04-25
Netdisk Managers, Userscript And Info_Data Collection

Userscript and info/data collection

Alist a filelist manager for all common cloud storage providers

for site collection list you could just search for it.

you can search for netdisk managers.

aliyun netdisk manager:

https://github.com/tickstep/aliyunpan

found a repo full of userscripts:

https://github.com/XIU2/UserScript

baidunetdisk cli go:

https://github.com/qjfoidnh/BaiduPCS-Go

bittorrent trackers:

https://github.com/XIU2/TrackersListCollection

script list:

护眼模式 简单有效的全网通用护眼模式、夜间模式、暗黑模式~ 安装 | 备用

知乎 美化 宽屏显示、暗黑模式、屏蔽首页活动、调整图片最大高度… 安装 | 备用

知乎 增强 移除登录弹窗、屏蔽首页视频、屏蔽用户、屏蔽关键词… 安装 | 备用

V2EX 增强 自动签到、链接转图片、自动无缝翻页、新标签页打开链… 安装 | 备用

Github 增强 高速下载 Git Clone/SSH、Release、Raw、Code(ZIP) … 安装 | 备用

Ping.Sx 增强 一键复制所有 IP、清理 IP 链接、快捷回到顶部 … 安装 | 备用

自动无缝翻页 * 无缝衔接下一页内容 (瀑布流) 支持各论坛/漫画/百度/谷歌等… 安装 | 备用

3DM论坛 美化 精简多余内容、样式优化 安装 | 备用

3DM论坛 增强 自动回复、自动无缝翻页、清理置顶帖子、自动滚至隐藏… 安装 | 备用

蓝奏云网盘 增强 * 右键显示菜单、直接下载文件、显示更多文件、自动密码… 安装 | 备用

新标签页打开链接 * 将网页中所有链接改为新标签页打开~ 安装 | 备用

DuckDuckGo 增强 屏蔽指定域名、修复图标加载、链接不携来源、快捷回到… 安装 | 备用

吾爱破解论坛 美化 精简多余内容、样式优化 安装 | 备用

吾爱破解论坛 增强 自动签到、自动无缝翻页、屏蔽导读悬赏贴 (最新发表页)… 安装 | 备用

全球主机交流论坛 增强 * 自动访问空间(22积分)、屏蔽用户、屏蔽关键词、自动翻… 安装 | 备用

Steam 创意工坊大图 修复 修复 Steam 创意工坊预览大图无法显示的问题 安装 | 备用

HTML5 视频音频默认音量 避免被 100% 音量吓一跳!且支持各网站分别记住音量… 安装 | 备用

Google 翻译 美化 精简多余内容、修复翻译结果溢出屏幕问题 安装 | 备用

智友邦论坛 美化 精简多余内容、样式优化、宽屏显示 安装 | 备用

智友邦论坛 增强 自动签到、自动回复、自动无缝翻页、快捷回到顶部、附… 安装 | 备用

autopager:

https://greasyfork.org/en/scripts/419215-%E8%87%AA%E5%8A%A8%E6%97%A0%E7%BC%9D%E7%BF%BB%E9%A1%B5

autopager supported websites:

< - - - - - - - - 网站 - - - - - - - - > 主页 分类 文章 评论 搜索 < - - - - - - - - - - - - - - - - - - - - - - - - - 备注 - - - - - - - - - - - - - - - - - - - - - - - - - >

所有 Discuz! 论坛 ✔ ✔ ✔ - ✔ 国内常见 论坛系统 (如:吾爱破解、3DM 等)

所有 phpBB 论坛 ✔ ✔ ✔ - ✔ 国外常见 论坛系统

所有 XenForo 论坛 ✔ ✔ ✔ - ✔ 国外常见 论坛系统

所有 NexusPHP 论坛 ✔ ✔ ✔ - ✔ 国内常见 论坛系统 (BT / PT 论坛)

所有 Flarum 论坛 ✔ ✔ ✔ - ✔ 简洁开源 论坛系统

所有 Xiuno 论坛 ✔ ✔ ✔ - ✔ 国内开源 论坛系统

所有 笔趣阁 网站 - - ✔ - - 小说网站常用的 笔趣阁 模板

部分 Typecho 网站 ✔ ✔ - - ✔ 适配一些常见的 Typecho 网站主题

部分 WordPress 网站 ✔ ✔ - - ✔ 适配一些常见的 WordPress 网站主题

部分 在线影视模板 网站 ✔ ✔ - - ✔ 适配一些常见的 在线影视 网站模板

部分 自带无缝翻页 网站 ✔ ✔ - - ✔ 适配一些支持 [加载更多] 的网站 (为了避免误触,规则比较保守)

[搜索引擎] <

谷歌 (Google) - - - - ✔ (建议开启各搜索引擎设置中的 新标签页打开链接 选项,以提高使用体验)

必应 (Bing) - - - - ✔ (微软的)

百度 - - - - ✔

搜狗 - - - - ✔

搜狗微信 ✔ ✔ - - ✔ (微信文章/公众号搜索)

头条搜索 - - - - ✔

神马搜索 - - - - ✔

无追搜索 - - - - ✔

360 搜索 - - - - ✔

Searxng - - - - ✔ (对各大搜索引擎的聚合搜索)

DuckDuckGo - - - - ✔ (以上这几个均支持手机版)

Startpage - - - - ✔

Yandex - - - - ✔ (俄罗斯的,如果卡住说明弹验证码了,请刷新网页后继续…)

Yahoo - - - - ✔ (包含 Yahoo JP 域名)

Qwant - - - - ✔

Ecosia - - - - ✔

Goobe - - - - ✔ (代码相关)

Magi - - - - ✔

轻搜 - - - - ✔

ASK - - - - ✔

[社区] <

贴吧 - ✔ ✔ - ✔ (如要发帖请点击右侧悬浮 [发帖] 按钮 或 点击左下角页码暂停翻页)

豆瓣 - ✔ ✔ ✔ - (短评、影评、评论、小组帖子 等等…)

知乎 - ✔ - - - (用户主页下的回答、文章 与 收藏夹页)

微博 - - - ✔ -

天涯 - ✔ ✔ - -

虎扑 - ✔ ✔ - -

NGA - ✔ ✔ - - (玩家相关)

V2EX ✔ ✔ - - -

煎蛋网 ✔ ✔ - ✔ -

水木社区 - ✔ ✔ - - (清华论坛)

龙的天空 - ✔ ✔ - - (小说相关)

看雪论坛 - ✔ - - - (安全相关)

番组计划 (Bangumi) - ✔ - - - (二次元版豆瓣?)

懂车帝论坛 - ✔ - - -

宽带山论坛 ✔ ✔ ✔ - - (上海地方论坛)

篱笆网论坛 ✔ ✔ ✔ - ✔ (上海地方论坛)

淘股吧论坛 ✔ ✔ ✔ - -

芥子空间论坛 - ✔ - - - (手游相关)

LowEndTalk ✔ ✔ ✔ - - (海外服务器相关)

RuTracker - ✔ ✔ - - (俄罗斯学习资源论坛)

A 岛 - ✔ ✔ - -

B 站 (Bilibili) - - - - ✔

[设计/素材] <

Pixiv - ✔ - - ✔ (插画)

Vilipix - ✔ - - ✔ (内容来自 Pixiv,下同 ⤵)

Pixivision - ✔ - - ✔

站酷 (ZCOOL) ✔ - - - - (图片/设计素材,下同 ⤵)

千图网 - ✔ - - ✔

千库网 - ✔ - - ✔

昵图网 - ✔ - - ✔

众图网 - ✔ - - ✔

我图网 - ✔ - - ✔

包图网 - ✔ - - ✔

图怪兽 - ✔ - - ✔

Pixabay - ✔ - - ✔

搜图神器 ✔ - - - ✔

素材中国 - ✔ - - ✔

iconfont - - - - ✔ (图标,下同 ⤵)

IconArchive - - - - ✔

Mixkit - ✔ - - ✔ (视频/音乐素材)

普象网 ✔ ✔ - - ✔ (产品设计,下同 ⤵)

学犀牛 ✔ ✔ ✔ - ✔

欧模网 - ✔ - - ✔ (模型素材,下同 ⤵)

下得乐 - ✔ - - ✔

[游戏] <

3DM - ✔ ✔ - - (包括论坛,下同 ⤵)

游侠网 - ✔ ✔ - -

游民星空 - - ✔ - -

3DM MOD - ✔ - - ✔ (游戏 MOD,下同 ⤵)

CurseForge - ✔ - - ✔

NexusMods - ✔ - - ✔

Steam 创意工坊 ✔ ✔ - - ✔ (创意工坊 MOD 文件下载1/下载2)

Steam 活动评论 - - - ✔ - (商家动态/活动下的评论区)

小霸王其乐无穷 ✔ ✔ - - ✔

Switch520 ✔ ✔ - - ✔

CS.RIN.RU - ✔ ✔ - ✔ (国外的游戏分享网站,下同 ⤵)

Byrutor ✔ ✔ - - -

Crackhub213 ✔ ✔ - - ✔

FitGirl Repacks ✔ ✔ - - ✔

Masquerade Repacks ✔ ✔ - - ✔

[影视/在线] <

茶杯狐 - - ✔ - ✔ (以下部分网站同时包含 BT/动漫)

NO 视频 - ✔ - - ✔

低端影视 ✔ ✔ - - ✔

奈菲影视 - ✔ - - ✔

在线之家 - ✔ - - ✔

片吧影院 - ✔ - - ✔

嗯哩嗯哩 - ✔ - - ✔

91 美剧网 - ✔ - - ✔

真不卡影院 - ✔ - - ✔

ZzzFun 动漫 - ✔ - - ✔ (仅动漫,下同 ⤵)

吐槽弹幕网 - ✔ - - ✔

樱花动漫 - ✔ - - ✔

怡萱动漫 - ✔ - - ✔

妮可动漫 - ✔ - - ✔

漫岛动漫 - ✔ - - ✔

AGE 动漫 - ✔ - - ✔

233 动漫 - ✔ - - ✔

Anime1 ✔ - - - ✔

[BT/下载] <

音范丝 ✔ ✔ - - ✔

片源网 - - - - ✔

磁力狗 - - - - ✔

雨花阁 - - - - ✔

BT 之家 ✔ ✔ - - ✔ (匹配所有包含 btbtt 的域名)

BD 影视 - ✔ - - ✔

高清电台 ✔ ✔ - - ✔

爱恋动漫 ✔ ✔ - - ✔ (动漫,下同 ⤵)

末日动漫 ✔ ✔ - - ✔ (包括 国际站)

动漫花园 ✔ ✔ - - ✔ (包括 镜像站)

简单动漫 ✔ ✔ - - ✔

零度动漫 ✔ ✔ - - ✔

ACG.RIP ✔ ✔ - - ✔

萌番组 ✔ ✔ - - ✔ (包括 Lite 版)

MioBT ✔ ✔ - - ✔

SkrBT ✔ ✔ - - ✔ (匹配所有包含 skrbt 的域名)

Nyaa ✔ - - - ✔

YTS - ✔ - - ✔ (这个 + 下面这两个算是我最常用的了~)

1337x ✔ ✔ - - ✔ (包括 镜像站)

RARBG ✔ ✔ - - ✔ (包括 镜像站)

Zooqle - ✔ - - ✔

Kickass - ✔ - - ✔

WebHD ✔ - - - ✔ (与 SubHD 字幕网站配套)

MINI4K - ✔ - - ✔ (与 A4k 字幕网站配套)

Trackerslist.com - - - - - (分享我自制自用的 Tracker 列表,多少会提高点 BT 下载速度~ 12k+⭐)

[字幕] <

A4k ✔ ✔ - - ✔

SubHD - ✔ - - ✔

伪射手网 - ✔ - - ✔

点点字幕 - - - - ✔

中文字幕网 - ✔ - - ✔

字幕库 ✔ ✔ - - ✔

[漫画] <

漫本 - ✔ ✔ - -

好漫 6 - ✔ ✔ - ✔

6 漫画 - ✔ ✔ - -

动漫狂 - ✔ ✔ - ✔ (部分早期章节,因网站问题而无法自动衔接下一章)

动漫啦 - ✔ ✔ - ✔

漫漫聚 - - ✔ - -

漫画猫 - ✔ ✔ - ✔

漫画皮 - ✔ ✔ - -

漫画人 - - ✔ - -

漫画柜 - ✔ ✔ - ✔

36漫画 - ✔ ✔ - ✔

爱漫画 - ✔ ✔ - ✔

漫画 DB - ✔ ✔ - ✔

HiComic (嗨漫画) - - ✔ - -

动漫之家 (主站) - ✔ ✔ - ✔ (这网站两个域名内容不一样 ⤵)

动漫之家 (日漫) - ✔ ✔ - ✔

阿狸漫画 - ✔ ✔ - ✔

快岸漫画 - ✔ ✔ - ✔

动漫之家 - - ✔ - -

动漫戏说 - ✔ ✔ - -

优酷漫画 - ✔ ✔ - ✔

拷贝漫画 - ✔ ✔ - -

木马漫画 - ✔ ✔ - -

漫画星球 - ✔ ✔ - -

风之动漫 - - ✔ - -

包子漫画 - - ✔ - -

乐语漫画 - ✔ ✔ - ✔

新新漫画 - ✔ ✔ - ✔

188漫画网 - - ✔ - -

古风漫画网 - ✔ ✔ - ✔

砂之船动漫家 - ✔ ✔ - ✔

Mangabz 漫画 - ✔ ✔ - ✔

Xmanhua 漫画 - ✔ ✔ - ✔

COCOMANGA 漫画 - ✔ ✔ - ✔

[小说] <

起点中文 - ✔ ✔ - -

七猫中文 - - ✔ - -

知轩藏书 - ✔ - - - (仅下载)

宝书网 - ✔ - - - (仅下载)

御书网 - ✔ ✔ - -

owLook - - ✔ - - (支持在线阅读的小说搜索引擎)

铅笔小说 - ✔ ✔ - -

无错小说网 - ✔ ✔ - ✔

读书族小说网 - - ✔ - -

哔哩轻小说 - ✔ ✔ - - (包括 手机版,轻小说,下同 ⤵)

话本小说网 - - ✔ - -

轻之文库 - ✔ ✔ - ✔

Archive of OurOwn - ✔ ✔ - ✔

精品书源 - - - - - (分享我自制自用的「阅读」APP 精品书源 1.6k+⭐)

[软件分享] <

蓝鲨 ✔ ✔ - - ✔

不死鸟 ✔ ✔ - - ✔

分享者 ✔ ✔ - - ✔

扩展迷 - ✔ - - - (浏览器扩展)

MacWK - ✔ - - ✔ (MAC 相关)

小众软件 ✔ ✔ - - ✔

乐软博客 ✔ ✔ - - ✔

果核剥壳 ✔ ✔ - - ✔

六音软件 ✔ ✔ - - ✔

反斗软件 ✔ ✔ - - ✔

微当下载 ✔ ✔ - - ✔

大眼仔旭 - ✔ - - ✔

423Down ✔ ✔ - ✔ ✔

发烧友绿软 ✔ ✔ - - ✔

异次元软件 ✔ ✔ - ✔ ✔

悪魔の小站 ✔ ✔ - - ✔

老殁殁漂遥 ✔ ✔ - - ✔

腾龙工作室 ✔ ✔ - - -

异星软件空间 ✔ ✔ - - ✔

Nite07 的小窝 ✔ - - - -

Sordum ✔ ✔ - - ✔ (国外的软件分享网站,下同 ⤵)

Winaero - ✔ - - -

LRepacks ✔ ✔ - - -

DlAndroid - ✔ - - ✔ (国外安卓 App 相关)

Winhelponline ✔ ✔ - - -

WindowsLatest ✔ ✔ - - -

TheWindowsClub ✔ ✔ - - -

[学术] <

Wiley Online Library - - - - ✔

ACS (Publications) - - - - ✔

Library Genesis - - - - ✔ (匹配所有包含 libgen 的域名)

ScienceDirect - - - - ✔

Z-Library - - - - ✔ (包括 镜像站)

PubMed - - - - ✔

X-MOL - ✔ - - ✔

维普网 - - - - ✔

科研通 - ✔ ✔ - ✔

酷科研 - - ✔ - -

小木虫 - ✔ ✔ - ✔

百度学术 - ✔ - - ✔

必应学术 (Bing) - - - - ✔

谷歌学术 (Google) - - - - ✔ 包括 镜像站1 / 2

国家自然科学基金 - - ✔ - -

[编程/技术] <

StackOverflow - ✔ - - ✔ 技术问答

SegmentFault - ✔ - - ✔

W3Cschool - ✔ - - - 编程教程

W3school - ✔ - - -

菜鸟教程 - ✔ - - -

博客园 ✔ ✔ - - ✔ 技术博客

51CTO ✔ ✔ - - ✔

Gitee - ✔ ✔ ✔ ✔ 开源分享

Github ✔ ✔ ✔ ✔ ✔ (建议搭配我另一个 Github 增强 - 高速下载 油猴脚本~)

[资讯/科技] <

ScienceAlert ✔ ✔ - - -

果壳网 ✔ ✔ - ✔ -

蓝点网 - ✔ - - -

可能吧 ✔ ✔ - - -

超能网 ✔ ✔ - - -

IT之家 - ✔ - - -

36 氪 - ✔ - - -

[其他] <

IMDb - ✔ - - ✔

烂番茄 - ✔ - - ✔

致美化 - ✔ - - - 系统美化

蓝奏云 - ✔ - - - 网盘 (后台及分享链接列表)

新片场 - ✔ - - - 视频短片

wikiHow - ✔ - - ✔ 指南

AfreecaTV ✔ ✔ - - - 直播 (大都是韩国人)

GreasyFork ✔ ✔ - ✔ ✔ 本站

UserScript - - - - ✔ 油猴脚本的聚合搜索 (Tampermonkey 作者做的)

UserStyles ✔ ✔ - ✔ ✔

Quicker ✔ ✔ - ✔ ✔

Xposed - ✔ - - ✔

书签地球 ✔ - - - ✔

什么值得买 - ✔ - - ✔

没得比导购 - ✔ - - ✔

叽哩叽哩日报 - ✔ - - -

彼岸图网 ✔ ✔ - - - 壁纸 (下同 ⤵)

必应壁纸 ✔ ✔ - - -

动漫壁纸 - ✔ - - ✔

动漫壁纸2 - ✔ - - ✔

HDQwalls ✔ ✔ - - ✔

Nastol ✔ ✔ - - ✔

以上仅为一小部分… 持续添加中,欢迎申请~

potential useful websites:

https://greasyfork.org/en/users/sign_in?return_to=%2Fen%2Fsc…%25E6%2597%25A0%25E7%25BC%259D%25E7%25BF%25BB%25E9%25A1%25B5 debugger eval code:1:60

https://greasyfork.org/scripts/419215-%E8%87%AA%E5%8A%A8%E6%…8%87%AA%E5%8A%A8%E6%97%A0%E7%BC%9D%E7%BF%BB%E9%A1%B5.user.js debugger eval code:1:60

https://greasyfork.org/en/help/installing-user-scripts debugger eval code:1:60

https://greasyfork.org/scripts/419081-%E7%9F%A5%E4%B9%8E%E5%…E%E5%BC%BA/code/%E7%9F%A5%E4%B9%8E%E5%A2%9E%E5%BC%BA.user.js debugger eval code:1:60

https://github.com/XIU2/UserScript debugger eval code:1:60

https://greasyfork.org/en/scripts/419215-%E8%87%AA%E5%8A%A8%E6%97%A0%E7%BC%9D%E7%BF%BB%E9%A1%B5/feedback#post-discussion debugger eval code:1:60

https://greasyfork.org/en/reports/new?item_class=script&item_id=419215 debugger eval code:1:60

https://www.jsdelivr.com/package/gh/XIU2/UserScript debugger eval code:1:60

https://www.discuz.net/ debugger eval code:1:60

https://www.phpbb.com/community/ debugger eval code:1:60

https://xenforo.com/community/ debugger eval code:1:60

https://demo.nexusphp.org/ debugger eval code:1:60

https://discuss.flarum.org/ debugger eval code:1:60

https://www.axiuno.com/ debugger eval code:1:60

https://www.google.com/ debugger eval code:1:60

https://cn.bing.com/ debugger eval code:1:60

https://www.baidu.com/ debugger eval code:1:60

https://www.sogou.com/ debugger eval code:1:60

https://weixin.sogou.com/ debugger eval code:1:60

https://www.toutiao.com/ debugger eval code:1:60

https://m.sm.cn/ debugger eval code:1:60

https://www.wuzhuiso.com/ debugger eval code:1:60

https://www.so.com/ debugger eval code:1:60

https://searx.owlook.com.cn/ debugger eval code:1:60

https://duckduckgo.com/ debugger eval code:1:60

https://www.startpage.com/ debugger eval code:1:60

https://yandex.com/ debugger eval code:1:60

https://search.yahoo.com/ debugger eval code:1:60

https://www.qwant.com/ debugger eval code:1:60

https://www.ecosia.org/ debugger eval code:1:60

https://goobe.io/ debugger eval code:1:60

https://magi.com/ debugger eval code:1:60

https://www.qingsearch.com/ debugger eval code:1:60

https://www.ask.com/ debugger eval code:1:60

https://tieba.baidu.com/ debugger eval code:1:60

https://movie.douban.com/ debugger eval code:1:60

https://www.zhihu.com/ debugger eval code:1:60

https://weibo.com/ debugger eval code:1:60

https://bbs.tianya.cn/ debugger eval code:1:60

https://bbs.hupu.com/ debugger eval code:1:60

https://bbs.nga.cn/ debugger eval code:1:60

https://v2ex.com/ debugger eval code:1:60

https://jandan.net/ debugger eval code:1:60

https://www.mysmth.net/ debugger eval code:1:60

https://www.lkong.com/ debugger eval code:1:60

https://bbs.pediy.com/ debugger eval code:1:60

https://bangumi.tv/ debugger eval code:1:60

https://www.dongchedi.com/car_fans_community debugger eval code:1:60

https://club.kdslife.com/ debugger eval code:1:60

https://www.libaclub.com/ debugger eval code:1:60

https://www.taoguba.com.cn/ debugger eval code:1:60

https://bbs.lieyou888.com/ debugger eval code:1:60

https://lowendtalk.com/ debugger eval code:1:60

https://rutracker.org/ debugger eval code:1:60

https://adnmb3.com/ debugger eval code:1:60

https://search.bilibili.com/ debugger eval code:1:60

https://www.pixiv.net/ debugger eval code:1:60

https://www.vilipix.com/ debugger eval code:1:60

https://www.pixivision.net/ debugger eval code:1:60

https://www.zcool.com.cn/ debugger eval code:1:60

https://www.58pic.com/ debugger eval code:1:60

https://588ku.com/ debugger eval code:1:60

https://www.nipic.com/ debugger eval code:1:60

https://www.ztupic.com/ debugger eval code:1:60

https://www.ooopic.com/ debugger eval code:1:60

https://ibaotu.com/ debugger eval code:1:60

https://818ps.com/ debugger eval code:1:60

https://pixabay.com/ debugger eval code:1:60

https://www.logosc.cn/so/ debugger eval code:1:60

http://www.sccnn.com/ debugger eval code:1:60

https://www.iconfont.cn/ debugger eval code:1:60

https://iconarchive.com/ debugger eval code:1:60

https://mixkit.co/ debugger eval code:1:60

https://www.puxiang.com/ debugger eval code:1:60

https://www.xuexiniu.com/ debugger eval code:1:60

https://www.om.cn/ debugger eval code:1:60

http://www.xiadele.com/ debugger eval code:1:60

https://www.3dmgame.com/ debugger eval code:1:60

https://www.ali213.net/ debugger eval code:1:60

https://www.gamersky.com/ debugger eval code:1:60

https://mod.3dmgame.com/ debugger eval code:1:60

https://www.curseforge.com/ debugger eval code:1:60

https://www.nexusmods.com/ debugger eval code:1:60

https://steamcommunity.com/workshop/browse/?appid=550&browsesort=trend&section=readytouseitems debugger eval code:1:60

https://steamworkshopdownloader.io/ debugger eval code:1:60

http://steamworkshop.download/ debugger eval code:1:60

https://steamcommunity.com/ debugger eval code:1:60

https://www.yikm.net/ debugger eval code:1:60

https://switch520.com/ debugger eval code:1:60

https://cs.rin.ru/forum/viewforum.php?f=10 debugger eval code:1:60

https://byrut.org/ debugger eval code:1:60

https://crackhub.site/ debugger eval code:1:60

https://fitgirl-repacks.site/ debugger eval code:1:60

https://masquerade.site/ debugger eval code:1:60

https://www.cupfox.app/ debugger eval code:1:60

https://www.novipnoad.com/ debugger eval code:1:60

https://ddrk.me/ debugger eval code:1:60

https://www.nfmovies.com/ debugger eval code:1:60

https://www.zxzjtv.com/ debugger eval code:1:60

https://www.pianba.tv/ debugger eval code:1:60

https://enlienli.com/ debugger eval code:1:60

https://mjw21.com/ debugger eval code:1:60

https://www.zhenbuka3.com/ debugger eval code:1:60

http://www.zzzfun.com/ debugger eval code:1:60

https://www.tucao.one/ debugger eval code:1:60

http://www.imomoe.live/ debugger eval code:1:60

http://www.yxdm.li/ debugger eval code:1:60

http://www.nicotv.me/ debugger eval code:1:60

https://www.mandao.tv/ debugger eval code:1:60

https://www.agemys.com/ debugger eval code:1:60

https://www.dm233.cc/ debugger eval code:1:60

https://anime1.me/ debugger eval code:1:60

https://www.yinfans.me/ debugger eval code:1:60

https://pianyuan.org/ debugger eval code:1:60

http://clg.im/ debugger eval code:1:60

https://www.yuhuage52.xyz/ debugger eval code:1:60

https://btbtt20.com/ debugger eval code:1:60

https://www.bd2020.com/ debugger eval code:1:60

https://gaoqing.fm/ debugger eval code:1:60

https://www.kisssub.org/ debugger eval code:1:60

https://share.acgnx.net/ debugger eval code:1:60

https://www.acgnx.se/ debugger eval code:1:60

https://share.dmhy.org/ debugger eval code:1:60

https://dmhy.anoneko.com/ debugger eval code:1:60

https://www.36dm.club/ debugger eval code:1:60

https://bt.acgzero.com/ debugger eval code:1:60

https://acg.rip/ debugger eval code:1:60

https://bangumi.moe/ debugger eval code:1:60

https://banguami.moe/lite debugger eval code:1:60

https://miobt.com/ debugger eval code:1:60

https://skrbtga.xyz/ debugger eval code:1:60

https://nyaa.si/ debugger eval code:1:60

https://yts.mx/ debugger eval code:1:60

https://1337x.to/ debugger eval code:1:60

https://rarbg.to/ debugger eval code:1:60

https://zooqle.com/ debugger eval code:1:60

https://kickasss.to/ debugger eval code:1:60

https://webhd.cc/ debugger eval code:1:60

https://www.mini4k.com/ debugger eval code:1:60

https://trackerslist.com/ debugger eval code:1:60

https://www.a4k.net/ debugger eval code:1:60

https://subhd.tv/ debugger eval code:1:60

https://assrt.net/ debugger eval code:1:60

http://www.ddzimu.com/ debugger eval code:1:60

https://cn.zimuzimu.com/ debugger eval code:1:60

https://zimuku.org/ debugger eval code:1:60

https://www.manben.com/ debugger eval code:1:60

https://www.haoman6.com/ debugger eval code:1:60

http://www.sixmh7.com/ debugger eval code:1:60

https://www.cartoonmad.com/ debugger eval code:1:60

https://www.dongman.la/ debugger eval code:1:60

http://www.manmanju.com/ debugger eval code:1:60

https://www.maofly.com/ debugger eval code:1:60

https://www.manhuapi.com/ debugger eval code:1:60

https://www.manhuaren.com/ debugger eval code:1:60

https://www.mhgui.com/ debugger eval code:1:60

https://www.36manga.com/ debugger eval code:1:60

https://www.imanhuaw.net/ debugger eval code:1:60

https://www.manhuadb.com/ debugger eval code:1:60

https://www.hicomic.net/ debugger eval code:1:60

https://www.dmzj.com/ debugger eval code:1:60

https://manhua.dmzj.com/ debugger eval code:1:60

http://www.alimanhua.com/ debugger eval code:1:60

https://www.kanbook.net/ debugger eval code:1:60

https://manhua.dmzj.com/ debugger eval code:1:60

https://comic.acgn.cc/ debugger eval code:1:60

https://www.ykmh.com/ debugger eval code:1:60

https://copymanga.net/ debugger eval code:1:60

https://www.omyschool.com/ debugger eval code:1:60

http://www.mhxqiu1.com/ debugger eval code:1:60

http://manhua.fffdm.com/ debugger eval code:1:60

https://www.webmota.com/ debugger eval code:1:60

https://www.leyuman.com/ debugger eval code:1:60

https://www.77mh.xyz/ debugger eval code:1:60

http://www.ccshwy.com/all/ debugger eval code:1:60

https://www.gufengmh9.com/ debugger eval code:1:60

https://www.szcdmj.com/ debugger eval code:1:60

https://mangabz.com/ debugger eval code:1:60

https://www.xmanhua.com/ debugger eval code:1:60

https://www.cocomanga.com/ debugger eval code:1:60

https://www.qidian.com/ debugger eval code:1:60

https://www.qimao.com/ debugger eval code:1:60

http://zxcs.me/ debugger eval code:1:60

https://www.baoshuu.com/ debugger eval code:1:60

https://www.yushubo.com/ debugger eval code:1:60

https://www.owlook.com.cn/ debugger eval code:1:60

https://www.23qb.com/ debugger eval code:1:60

https://www.xineyby.com/ debugger eval code:1:60

https://m.xiaoshuo77.net/ debugger eval code:1:60

https://www.linovelib.com/ debugger eval code:1:60

https://w.linovelib.com/ debugger eval code:1:60

https://www.ihuaben.com/ debugger eval code:1:60

https://www.linovel.net/ debugger eval code:1:60

https://archiveofourown.org/ debugger eval code:1:60

https://yuedu.xiu2.xyz/ debugger eval code:1:60

https://www.lan-sha.com/ debugger eval code:1:60

https://iao.su/ debugger eval code:1:60

https://www.sharerw.com/ debugger eval code:1:60

https://www.extfans.com/ debugger eval code:1:60

https://www.macwk.com/ debugger eval code:1:60

https://www.appinn.com/ debugger eval code:1:60

https://www.isharepc.com/ debugger eval code:1:60

https://www.ghxi.com/ debugger eval code:1:60

https://www.6yit.com/ debugger eval code:1:60

http://www.apprcn.com/ debugger eval code:1:60

https://www.weidown.com/ debugger eval code:1:60

https://www.dayanzai.me/ debugger eval code:1:60

https://www.423down.com/ debugger eval code:1:60

https://fsylr.com/ debugger eval code:1:60

https://www.iplaysoft.com/ debugger eval code:1:60

http://www.mubolin.cn:99/ debugger eval code:1:60

https://www.mpyit.com/ debugger eval code:1:60

https://www.tenlonstudio.com/ debugger eval code:1:60

https://www.yxssp.com/ debugger eval code:1:60

https://www.nite07.com/ debugger eval code:1:60

https://www.sordum.org/ debugger eval code:1:60

https://winaero.com/ debugger eval code:1:60

https://lrepacks.net/ debugger eval code:1:60

https://dlandroid.com/ debugger eval code:1:60

https://www.winhelponline.com/blog/ debugger eval code:1:60

https://www.windowslatest.com/ debugger eval code:1:60

https://www.thewindowsclub.com/ debugger eval code:1:60

https://onlinelibrary.wiley.com/ debugger eval code:1:60

https://pubs.acs.org/ debugger eval code:1:60

https://libgen.rs/ debugger eval code:1:60

https://www.sciencedirect.com/ debugger eval code:1:60

https://z-lib.org/ debugger eval code:1:60

https://pubmed.ncbi.nlm.nih.gov/ debugger eval code:1:60

https://www.x-mol.com/ debugger eval code:1:60

http://www.cqvip.com/ debugger eval code:1:60

https://www.ablesci.com/ debugger eval code:1:60

https://www.coolkeyan.com/ debugger eval code:1:60

http://muchong.com/bbs debugger eval code:1:60

https://xueshu.baidu.com/ debugger eval code:1:60

https://cn.bing.com/academic debugger eval code:1:60

https://scholar.google.com/ debugger eval code:1:60

https://sc.panda321.com/ debugger eval code:1:60

https://xs2.dailyheadlines.cc/ debugger eval code:1:60

https://output.nsfc.gov.cn/ debugger eval code:1:60

https://stackoverflow.com/ debugger eval code:1:60

https://segmentfault.com/ debugger eval code:1:60

https://www.w3cschool.cn/ debugger eval code:1:60

https://www.w3school.com.cn/ debugger eval code:1:60

https://www.runoob.com/ debugger eval code:1:60

https://www.cnblogs.com/ debugger eval code:1:60

https://www.51cto.com/ debugger eval code:1:60

https://gitee.com/ debugger eval code:1:60

https://www.sciencealert.com/ debugger eval code:1:60

https://www.guokr.com/ debugger eval code:1:60

https://www.landian.vip/ debugger eval code:1:60

https://kenengba.com/ debugger eval code:1:60

https://www.expreview.com/ debugger eval code:1:60

https://www.ithome.com/ debugger eval code:1:60

https://36kr.com/ debugger eval code:1:60

https://www.imdb.com/ debugger eval code:1:60

https://www.rottentomatoes.com/ debugger eval code:1:60

https://zhutix.com/ debugger eval code:1:60

https://lanzou.com/ debugger eval code:1:60

https://www.xinpianchang.com/ debugger eval code:1:60

https://zh.wikihow.com/ debugger eval code:1:60

https://www.afreecatv.com/ debugger eval code:1:60

https://www.userscript.zone/ debugger eval code:1:60

https://userstyles.world/ debugger eval code:1:60

https://getquicker.net/ debugger eval code:1:60

https://repo.xposed.info/module-overview debugger eval code:1:60

https://www.bookmarkearth.com/ debugger eval code:1:60

https://www.smzdm.com/ debugger eval code:1:60

https://www.meidebi.com/ debugger eval code:1:60

https://www.jiligamefun.com/ debugger eval code:1:60

https://pic.netbian.com/ debugger eval code:1:60

https://bing.ioliu.cn/ debugger eval code:1:60

https://konachan.net/ debugger eval code:1:60

https://anime-pictures.net/ debugger eval code:1:60

https://hdqwalls.com/ debugger eval code:1:60

https://www.nastol.com.ua/ debugger eval code:1:60

https://www.snapmail.cc/ debugger eval code:1:60

https://pan.lanzouo.com/b073l8d1e debugger eval code:1:60

https://microsoftedge.microsoft.com/addons/detail/tampermonkey/iikmkjmpaadaobahmlepeloendndfphd?hl=zh-CN debugger eval code:1:60

https://zhuanlan.zhihu.com/p/276027099

Read More

2022-04-25
Content Usage

Use the original transcript for paraphrasing, while using danmaku for joke generation.

Read More

2022-04-21
Mmdetection And Mmd Dancing

3d 虚拟形象动作生成 视频生成 虚拟偶像 Vtuber:

https://github.com/xianfei/SysMocap

human pose detection:

https://github.com/facebookresearch/VideoPose3D

opengl recording:

https://lencerf.github.io/post/2019-09-21-save-the-opengl-rendering-to-image-file/

http://www.songho.ca/opengl/gl_pbo.html#pack

https://stackoverflow.com/questions/7634966/save-opengl-rendering-to-video

https://www.codeproject.com/articles/15941/recording-directx-and-opengl-rendered-animations

https://www.glfw.org/documentation.html

download expose models:

https://expose.is.tue.mpg.de/downloads

smpl-x model download:

https://smpl-x.is.tue.mpg.de/download.php

model zoo:

https://github.com/Zhongdao/Towards-Realtime-MOT/blob/master/DATASET_ZOO.md

mmd auto tracking:

https://github.com/errno-mmd/mmdmatic/blob/master/setup.bat

https://github.com/miu200521358/expose_mmd

https://github.com/miu200521358/AlphaPose-MMD

smplx expose alternative body tracker:

https://github.com/vchoutas/smplx

face tracking:

https://github.com/Aditya-Khadilkar/Face-tracking-with-Anime-characters

anime face detector:

https://github.com/nagadomi/lbpcascade_animeface

https://github.com/qhgz2013/anime-face-detector

anime facial features:

https://github.com/pranau97/anime-detection

repair anime images:

https://github.com/youyuge34/Anime-InPainting

paint manga from sketch (with color blocks):

https://github.com/youyuge34/PI-REC

if we can re-trace the action/expression done by vtubers, we can monetize those “highlight cuts”.

you can firstly find points in datasets and then generate mmd videos, and then create trainset. you can also generate pose from raw video and then create dataset.

found occasionally when browsing MMD, but found this with so many stars, which is an instance detection/segmentation library.

https://github.com/open-mmlab/mmdetection

while rendering mmd can be done with mmd viewer like https://github.com/benikabocha/saba or could use renderer like blender or unity. we must bake physics before dancing.

found other dedicated renderer for mmd, with bullet physics:

https://github.com/jinfagang/mmc

found interesting repo of poetry composing:

https://github.com/jinfagang/tensorflow_poems

mediapipe/paddlevideo alike:

https://pypi.org/project/alfred-py/

three.js has multiple loaders:

https://github.com/mrdoob/three.js/tree/dev/examples/js/loaders

https://github.com/hanakla/three-mmd-loader

render MMD using saba lib:

https://github.com/WLiangJun/MMD-Desktop-mascot

https://github.com/miu200521358/expose_mmd/fork

music based dance:

https://github.com/DeepVTuber/DanceNet3D

https://github.com/ColbyZhuang/music2dance_DanceNet

https://github.com/caijianfei/Music2Dance

characters:

https://www.mixamo.com/#/?page=1&type=Character

Read More

2022-04-21
Articulated Animation

This one is dead simple. Use real human to talk as you go.

https://github.com/snap-research/articulated-animation

Read More

2022-04-21
Graphcore Support For Ai

Graphcore’s IPU could be cheaper and faster than NVIDIA’s A100, though need sharing on-board RAM.

Supports tensorflow, pytorch, paddlepaddle.

https://docs.graphcore.ai/en/latest/

pytorch: poptorch, pytorch-lightning(tpu and ipu)

tensorflow:

from tensorflow.python import ipu

Create an IPU distribution strategy

strategy = ipu.ipu_strategy.IPUStrategy()

with strategy.scope():

paddlepaddle:

https://github.com/graphcore/portfolio-examples/tree/master/paddlepaddle/bert-base

https://github.com/graphcore/Paddle.git

TensorFlow 1 & 2 support with full performant integration with TensorFlow XLA backend

PyTorch support for targeting IPU using the PyTorch ATEN backend

PopART™ (Poplar Advanced Runtime) for training & inference; supports Python/C++ model building plus ONNX model input

Full support for PaddlePaddle

Other frameworks support coming soon

Read More

2022-04-19
Optical Flow, Slow Motion And More

https://github.com/slowmoVideo/slowmoVideo

it uses gpu and optical flow to do frame interpolation.

able to do instance segmentation if the optical flow boundary is clear and continuous.

build opencv with opencv_contrib and -DWITH_CUDA=ON to enable cudaoptflow.

Read More

2022-04-17
RSS Feeds

kuxai ai related articles, there’s some bot keep posting this shit to qq group

rsshub most extensible rss feeder, can turn bilibili, zhihu, or anything into rss

medium.com

Searching for existing rss sources. You may want to make your own by means of social media. It could be the feeding source of reviewer or producer.

https://www.baidu.com/ssid=4d994e69636f5f4e69636f6c6532353311dd/from=844b/s?word=rss订阅源&ts=7538593&t_kt=0&ie=utf-8&fm_kl=021394be2f&rsv_iqid=4109465110&rsv_t=a02fgTXA5yrpeGBRWrTCqcc9bK%252FKmzIRzII6usvAqgJjawViUjevc88MAg&sa=is_5&ms=1&rsv_pq=4109465110&rsv_sug4=6166&tj=1&ss=110&inputT=3395&sugid=110161509475552&rq=rss

https://www.appstoredate.com/iphone/6990.html

https://blog.csdn.net/wangjialiang/article/details/121510405

https://baijiahao.baidu.com/s?id=1677152782752706400&wfr=spider&for=pc&searchword=rss订阅源

https://www.bilibili.com/read/mobile?id=8961024

https://m.baidu.com/from=844b/ssid=4d994e69636f5f4e69636f6c6532353311dd/s?word=rss源地址订阅大全&sa=brs_7&rq=rss订阅源&rsf=100631857&pqid=8915434938561485118&ms=1&rqid=8915434938561485118&params_ssrt=node-san

https://m.baidu.com/from=844b/ssid=4d994e69636f5f4e69636f6c6532353311dd/s?word=订阅源整合&sa=brs_6&rq=rss订阅源&rsf=100631112&pqid=8915434938561485118&ms=1&rqid=8915434938561485118&params_ssrt=node-san

https://m.baidu.com/from=844b/ssid=4d994e69636f5f4e69636f6c6532353311dd/s?word=知乎日报rss源&sa=brs_4&rq=rss订阅源&rsf=100631113&pqid=8915434938561485118&ms=1&rqid=8915434938561485118&params_ssrt=node-san

https://www.zhihu.com/question/25071126/answer/875901493

https://zhuanlan.zhihu.com/p/53989966

https://m.baidu.com/from=844b/ssid=4d994e69636f5f4e69636f6c6532353311dd/s?word=各大网站RSS订阅源地址&sa=re_dl_prs_34689_1&rqid=10035302357898163828&params_ssrt=node-san&rq=知乎日报rss源&rsf=100631113&asctag=2470

https://www.tutorialspoint.com/python_text_processing/python_reading_rss_feed.htm

https://www.datasciencelearner.com/how-to-read-rss-feed-in-python/

https://wiki.python.org/moin/RssLibraries

https://stackoverflow.com/questions/2244836/rss-feed-parser-library-in-python

https://pypi.org/project/rss-reader/

https://github.com/lemon24/reader

https://reader.readthedocs.io/en/latest/

we need cleaner view by using readbility.js, but how to preserve pictures? is it built-in?

pictures could be a big fingerprint. better deal them with link extracter and shufflers.

you want python version or nodejs version?

1
2
3
4
npm install @mozilla/readability
# it can be invoked via api, standalone!
# you might want to call javascript from python

1
2
3
pip3 install readability-lxml
# some lags behind?

this is for the reader mode, make webpage readable

https://github.com/luin/readability

https://github.com/phpdocker-io/readability-js-server

https://github.com/mozilla/readability

https://github.com/alan-turing-institute/ReadabiliPy

https://github.com/edgartaor/kindleServer

https://requests-html.kennethreitz.org

https://github.com/psf/requests-html

https://github.com/MHordecki/readability-redux/blob/master/readability/readability.js

https://github.com/buriy/python-readability

https://stackoverflow.com/questions/56857506/how-to-enable-reader-mode-distill-page-with-puppeteer

Read More