pyjom dev schedules

整活

• 应 急 诈 骗 食 品 (派蒙加Rick Ashley 如何混合？）

recommendation

• use txtai to do NLU and recommend things to people

topic discovery/acquiring

trending topics

• baidu search trending

• sogou trending

• bilibili trending

• wechat trending

• toutiao trending

• tencent trending

• netease trending

• youtube trending

• reddit trending

• twitch trending

popular topics

• baijiahao popular topics

• bilibili popular topics

• douyin popular topics

personal/customized topics

• tencent qq customized (can associate with mail)

• wechat customized

• bilibili per user customized

dog/cat video generation

make render engine runnable

issues:

• video length too long (10 mins)

it was the speed calculation error.

• bgm somehow not in sync (too broad bpm/clip ranges?)

• to analyze the peaks (abrupt changes) in bgm and grab louder peaks using pyloudnorm (getting audio volume)

1
2

pip3 install pyloudnorm

1
2
3
4
5
6
7
8

import soundfile as sf
import pyloudnorm as pyln
data, rate = sf.read("0055014.wav") # load audio (with shape (samples, channels))
print(data.shape)
meter = pyln.Meter(rate) # create BS.1770 meter
loudness = meter.integrated_loudness(data) # measure loudness
print(loudness)

• place video on loudest points, abrupt changes detected by talib or just take direvative and gaussian average

• video too repetitive (small corpus?)

• do not remove subtitle and crop active region (reviewer’s resource not used? but i rather advise you to do it directly since it requires less computational power)

• do not have minimum motion threshold (reviewer’s fault? also recommend you to do this in producer)

• remove all watermarks, subtitles and crop video boundaries accordingly

• source video and audio (infinite, basic test is to find 500 sources at once without duplicate, second test is to find 500 second is to find 500 without duplicate twice), improve highlight algorithm

• find 500 songs without duplicate at once

• find 500 songs no duplicate twice

• find 500 animal videos without duplicate

• find 500 animal videos no duplicate twice

• generate appropriate title, cover, info and tags

• collect feedback after the post

• find some shocking fonts for cover and subtitle, english and chinese

• make that karaoke effect

• make ass with karaoke effect with lrc files

• make lyrics sync logic fluent, according to what have learned from karaoke effects

• make selected video clips fluent, no abrupt cuts, maybe we need pyscenedetect?

text to video, template based video generator (this is perhaps the most complex video generator ever. do it with caution, it might also includes the flipcard, narrator and slideshow based generators)

generator models subarchitecture (subcategories of template based generators)

flipcard

slideshow (video and audio, might also include the dog&cat video!)

narrator

summarized video

policy evasion, NSFW filters

• remove all hints from image, video, audio and script that may lead to copyright issues

analyze the media content and metadata, relationships

• analyze danmaku

• paraphrase the script

• cut the crap and understand each clip’s meaning

process the video clips, like changing the human figure, changing face, stylish the video, adding 2d to 3d effects

process the audio clips, like changing voice, adding sound effects, separating audio/music tracks, ducking

index, retrieve and align video and audio content according to our collected database

retrieve and align video and audio according to our smart search agent (keyword extractor, related words) and do live compilation

qq managing

• mitm chats in friends

• mitm chats in groups

• source and send pictures to qzone

• source and send pictures to chat

• reduce posting frequency by group size and feedback

• post relative video link relative to group topic

personal info collecting and email/sms bulk sending

• avoid mail being trashed or turned into junk

• collect and make mail templates for mail posting

voice changer

• vst based voice changer

• train or find a decent voice generator 御姐音语料库 小受音语料库

请在b站或者qq群里面寻找 或者什么其他的有关的地方寻找 谢谢

直播 live streaming

• source the video

如果是同一个站的 尽量放一个月以前的视频 半个月以前的音频

• prepare some space for storing live streaming data

• source the audio

• automatic interactions

• handle the vtuber model’s actions

i decided to push myself a little bit by setting up schedules. no due date but it might make it clear for me to work on which project first.

though i could write what i want to do next in diary of course. the primary target is to make general schedules of course, the second or the target afterwards is to complete the development of the dog video generator.

review previous notes and fill blanks, list blanks below, better with direct link to it

• tag all notes, especially mark out those stub, incomplete ones

• review and complete bilibili courses, reorder, rename and split them if necessary

• 传播学导论把笔记做完

review your history

• visit all previously visited links and store briefs generated by readbility.js and elinks

finance and quantatitive trading

• design a basic algorithm and complete regression test on joinquant

• design and complete one regression test offline

artificial general intelligence

• design a program automatically execute commands in shell

• design a program automatically click everywhere in GUI

study nars

• run python version of nars

study opencog

study he4o

indexing necessary tools, blogs, procedures, manuals, snippets and search them

• indexing kali tools

• use hacker’s search engines

github coin (xmrig) mining

• automatic captcha resolve by clash redirection to force the captcha not being too complex

• create better labeling interface for spiral picture detection

• automate the whole process unsupervised

• find more ways to mine coins other than cirrus

• hide our intention of coin mining

• create or reassure our monero wallet

bilibili seo and hacking

study bilibili source code

study and learn some parameters/apis for faking data

general hacking and tool learning

study popular tools

frida

cutter

radare2

study popular kali tools

• nmap script to find nearby hosts in same router

• metasploit script to scan vulnerable hosts

solve ctf challenges

study hacking posts

study hacking tutorial on darkweb

• find a free hacking tutorial on darkweb

linux

for gnome, there’s a built in disk usage manager called baobab.

filelight for kde

qdirstat

find things in colab, kaggle, aistudio, bilibili, youtube.

see in huggingface tasks to find task-specific models, also huggingface spaces for demo on models

modelscope by alibaba supports tensorflow and pytorch

mindspore model zoo

mindspore hub

intel model zoo

run models from intel model zoo in docker container, like recommendation

openvino model zoo

百度总结的 比较全面的深度学习应用 deeplearning applications

jina hub

阿里巴巴模型库 具有许多适用于商业 自媒体的模型供选择

huggingface

苹果官方CoreML模型库

CoreML第三方模型库

paddle模型库 paddlehub

pytorch模型库

TensorFlow模型库

graphcore model zoo for IPU

npm

npm报错：unable to verify the first certificate

1
2
3

npm config set strict-ssl false
npm config set ca=""

npm download binary files from github will raise error since the download speed is low.

use cnpm instead, since it will route all github binary requests to mirrored cnpm cdn.

1
2

npm i -g cnpm

set some binary distribution file mirror to https://registry.npmmirror.com in ~/.npmrc and ~/.yarnrc:

1
2
3
4
5
6
7
8

canvas_binary_host_mirror=https://registry.npmmirror.com/-/binary/canvas/
sass_binary_site=https://registry.npmmirror.com/-/binary/node-sass
nodejs_org_mirror=https://registry.npmmirror.com/-/binary/node/
electron_mirror=https://registry.npmmirror.com/-/binary/electron/
electron_builder_binaries_mirror=https://registry.npmmirror.com/-/binary/electron-builder-binaries/
chromedriver_cdnurl=https://registry.npmmirror.com/-/binary/chromedriver/
registry=https://registry.npmmirror.com

文章多平台发布 浏览器插件 一键同步文章到多个内容平台，支持今日头条、WordPress、知乎、简书、掘金、CSDN、typecho各大平台，一次发布，多平台同步发布。解放个人生产力

3d pose tracker

rendered on unity. needs GPU.

Sysmocap

WHAT I WANT FOR (or nearly) requires real 3d models, written in javascript

cannot output video?

A cross-platform real-time video-driven motion capture and 3D virtual character rendering system for VTuber/Live/AR/VR.

Does not require a discrete graphics card and runs smoothly even on eight-year-old computers

Vtuber python unity

search for “vtuber” along with “motion capture” you will get many head-only trackers and renderers for windows but not linux, also some “broadcast templates/frameworks”. many support one single image (anime head + remove background) as input instead of 2d/3d models

face tracking only, showing face, mouth and eyes, head directions, bind to live2d models

虚拟数字人 metahuman

NextHuman Beta0.9上线公测，5分钟高品质讲解，带你进入数字人“零门槛”创作新时代，体验直通车 -> https://nexthuman.cn 免费版是Windows上面跑的 需要高端1070显卡

anime character segmentation

to remove false positives, make sure we have anime face in view, otherwise mark it as a false positive.

you can use anime character recognition like moeflow or opencv anime face detector along with some phash or perceptual hash library to group similar characters, compare perceptual image similarity and line them up in a series.

aniseg, able to segment anime character and head, using mask-rcnn

yet another anime character segmentation model using solov2 and condinst

waifu segmentation

high accuracy anime character segmentation

自动画漫画 画几笔就成某个人像 动漫头像

https://menyifang.github.io/projects/DCTNet/DCTNet.html

自动捏脸 gan给人脸戴口罩

https://github.com/futscdav/Chunkmogrify

selfie to anime, picture to anime photos

selfie2anime with trained models

##原神mmd下载模型

模之屋（需要注册）：

https://www.aplaybox.com/u/680828836

夕蓝资源网（可直接下载） 也有其他的3d模型可以下载：

https://www.seoliye.com/tags/53.html

use voice to power up static images

voice powered animated cartoon figure

jeeliz (some web deep learning runtime, like tensorflow.js) powered

weboji, highly similar to animoji, with three.js and cute fox avatar

face filter, alter the face like putting glass, minor changes to avoid privacy/copyright concerns?

openface

facial features extraction

facerig

facerig location: /Software/Program Files (x86)/FaceRig

i’ve seen python code inside facerig.

facerig does not offer head-only rendering, but that could be changed i suppose?

avatarify python

infinite avatars by using style gan, first order motion model

create static portrait avatar (svg?)

animoji from apple

facial landmark detection in python, animoji-animate

animoji apple private framework 实际上这个就是之前看到的会动的狗屎的视频来源

2d模型 皮套 可动 虚拟Vtuber talking head

https://github.com/yuyuyzl/EasyVtuber

https://github.com/pkhungurn/talking-head-anime-3-demo

https://github.com/GunwooHan/EasyVtuber

b站官方

直播姬现在支持2d面部捕捉 3d模型动作捕捉

直播姬版本有windows macos(m1) Android版本

2d模型是live2d的模型

有待研究

qq seems to release mac qq with electron, lot more easier for reverse engineering

how to reverse go binary, golang reverse

opqbot官方已经说了 登陆过程中会用到远程的服务器 这个服务器究竟在干什么不得而知 可能和登陆有关也可能没有关系 但是服务器维护期间是没法扫码登录的 如果有可以正常使用的secdata是可以直接启动服务的 不需要服务器 所以估计这个服务器很可能就是拿来解析cookie的

login error:

1
2
3
4
5
6
7
8
9
10
11
12
13
14

2022/08/14 00:01:24.808 [I]  Scan Status 48 Uin 0
2022/08/14 00:01:25.880 [I]  Scan Status 48 Uin 0
2022/08/14 00:01:26.937 [I]  Scan Status 53 Uin 0
2022/08/14 00:01:27.998 [I]  Scan Status 53 Uin 0
2022/08/14 00:01:29.054 [N]  User <userId> 登录中..请勿连续操作,登录成功后或释放连接后在继续操作 登陆成功后请勿频繁扫码再次登陆(除非冻结导致的掉线) 发不出去群消息请挂机几天 TX日常风控
=========本框架 🎈 免费 🎈 使用 谨防 ⚠️ 诈骗 ⚠️ 收费 切勿用于 🈲️ 非 🈲️ 法用途
=========交流群:757360354 TG群组:https://t.me/IOTQQ
=========开源社区 👍 https://github.com/opq-osc 👍
=========项目主页 😄 https://github.com/OPQBOT/OPQ/wiki 😄
=========项目Wiki 📒 https://github.com/OPQBOT/OPQ/wiki 📒
2022/08/14 00:02:30.234 [W]  recvPump session 0D48F5949075DA13D3A9F83838903920
2022/08/14 00:02:30.234 [A]  Default Closed:0D48F5949075DA13D3A9F83838903920
2022/08/14 00:02:30.235 [D]  Unregister In Conn -> 0D48F5949075DA13D3A9F83838903920

关于自动加群 可以考虑使用安卓手机自启动功能（需要下载startup manager 或者boot manager（有root权限和xposed框架）） 用termux-appium 自动操作手机在联网的情况下自启动加群

现在有两个标准onebot nonebot

这两个协议都不支持主动加好友 加群 还有收红包方法 至少mac qq协议支持这些方法 但是其他的协议比如手表 ipad协议支不支持就不清楚了

onebot有大量的qq适配器 而nonebot有大量的插件和除了qq以外的连接器

nonebot可以连接onebot

在onebot的qq适配器中 oicq可以查看qq历史聊天记录（有待验证） 可能对qq的数据爬取有帮助 视频爬取 oicq这个适配器有在群里面加好友的方法addFriend(gid, uid)可以参考,提供了一些用于逆向qq协议的程序：

txhook 该软件适合在安卓8.0以上系统运行，理论支持安卓7.0以上，但是很多问题。群号：901422091 702991373

• 获取ShareKey\PublicKey\D2\A2…

• 主动拦截固定Ecdh密钥及版本

• 对Jce\Protobuf的自动分析

• 过滤抓包，支持高级过滤（长按抓包页面的搜索栏展示/隐藏图标）

protobuf online decode

protobuf unpack-tools

也有一些可以进行二次开发的qq web api 搜索QQ号和群号 且有个性签名等更多信息 或许可以搜索关键词？

这些适配器中有的提供了qq频道的支持：

oicq-guild

也可以考虑用frida ghidra radare2 cutter来逆向opqbot的go编译好了的程序 或者逆向分析opqbot的网络请求数据 甚至直接动态调用opqbot里面的方法 直接用其他机器人登陆之后获得的cookie进行操作

to get the token, login first, then visit here or click “sign in” here

据说扫码登录只支持同一个ip下面的登陆 不知道为什么这个opqbot登陆失败 但是其他机器人都提供了账号密码登陆的渠道 将opqbot的协议逆向出来 或许可以提高登陆成功率 实现相同的功能

默认(可修改)在 ./data/your-account/ 下会自动生成device.json设备文件，登录完成后此设备文件长期有效

设备文件的生成并非随机，而是使用固定算法，一个账号会永远生成同一份设备文件

如果需要在异地服务器上登录，建议先在常用地通过设备验证并登录挂机一段时间

由于会生成相同设备文件，只要不手动修改，只需验证一次，在任何地区都可直接登录

it seems the login issue of opqbot is related to the account itself, not gitter token, software version or proxy

by the way we could always use go-cqhttp, without the ability to collect red packet and add group/friends.

qq add group/friends may be enabled by our windows virtual machines. without opq, it is very memory intensive.

tokens:

1
2

74eb7eb14aa36d1b9c2c663bc49335e8becd5318

1
2

2d391bd7639362032d09abfc5a9cc6368b7664d5

1
2

bdf52599d992665509ee5b0b533d5eed08452def