Autonomous Machines & Society.

2022-11-03
Discover '问财选股': The Comprehensive Stock Selection Platform And Python Implementation

Read More

2022-11-03
Mastering Android Reverse Engineering Tools: Ida, Ghidra, Frida, Gda And Flowdroid

安卓反编译

ida ghidra frida

frida extension/helper methods

attach existing process

1
2
3
4
sudo frida-ps
sudo frida -n WeChat
sudo frida -p [pid]

gda 交互式Android反编译 支持数据流追踪

flowdroid

Read More

2022-11-03
Tencent Jce

jce is a tcp protocol, like protobuf

jcestruct usage

1
2
python -m jce 1f2e3d4c5b6a79

发送tcp数据判断mitm当中箭头含义

Read More

2022-10-31
Qzone Send Shuoshuo

opqbot qzone module replacement

animeapi more than just sending shuoshuo

login via qrcode

playwright upload file

有很多上传接口 都可以这样自动化 因为这些接口可能会变化 自己写成playwright脚本是最省事的方案

Read More

2022-10-29
Keyword Extraction, Topic Modeling, Sentence Embedding

language models

allennlp-models

bert lang street

recommendation

deepmatch

fuzzywuzzy or thefuzz

fzf a commandline fuzzy matcher

iterfzf as a fzf python binding and its related projects

rapidfuzz

stopwords

1
2
from nltk.corpus import stopwords

stopwordsiso in python

summarization

sumy Simple library and command line utility for extracting summary from HTML pages or plain texts

pytextrank Python implementation of TextRank as a spaCy pipeline extension, for graph-based natural language work plus related knowledge graph practices; used for for phrase extraction and lightweight extractive summarization of text documents

summa TextRank implementation for text summarization and keyword extraction in Python 3, with optimizations on the similarity function.

keyword extraction

rake-nltk RAKE short for Rapid Automatic Keyword Extraction algorithm, is a domain independent keyword extraction algorithm which tries to determine key phrases in a body of text by analyzing the frequency of word appearance and its co-occurance with other words in the text.

multi-rake Multilingual Rapid Automatic Keyword Extraction (RAKE) for Python

yake Unsupervised Approach for Automatic Keyword Extraction using Text Features

tutorial and libraries

keybert uses sentence transformer to do the job

kwx

pke Python Keyphrase Extraction module

1
2
3
4
import jieba.analyse as ana
# methods under ana:
# ['analyzer', 'default_textrank', 'default_tfidf', 'extract_tags', 'set_idf_path', 'set_stop_words', 'textrank', 'tfidf']

Read More

2022-10-27
Nvidia Driver Switch Alternatives

alpharetta uses tesla-450 driver

1
2
update-glx --config nvidia

Read More

2022-10-27
Use Javascript/Html/Css To Create Mobile App, Simplifying The Processing Of Creating App

Apache Cordova is an open-source mobile development framework

re-com A ClojureScript library of reusable components for Reagent

Read More

2022-10-27
Peewee Related Notes

extensions

peewee extension docs

official doc on full-text search

how to use ftsmodel

Peewee包括 SQLite extension module 它提供了许多特定于sqlite的功能,例如 full-text search , json extension support 还有更多。如果您想使用这些出色的功能,请使用 SqliteExtDatabase 从 playhouse.sqlite_ext 模块:

1
2
3
4
5
6
from playhouse.sqlite_ext import SqliteExtDatabase
sqlite_db = SqliteExtDatabase('my_app.db', pragmas={
'journal_mode': 'wal', # WAL-mode.
'cache_size': -64 * 1000, # 64MB cache.
'synchronous': 0}) # Let the OS manage syncing.

enhancement proposals

enhancement for doing get/update/create at the same time

enhancement to simplify the BaseModel boilerplate code

Read More

2022-10-27
临时存储文件 Temp Fiiles Host Api

临时存储文件 temp files host api

用于给粉丝发放福利 充值之后发涩图

sharex a screen capture, file sharing, productivity tool

tools

pyupload

catmoe recommend tools

uguu tools

支持api存储

anonyfiles api need login

list of pomf based temp file hosts

uguu api

catbox.moe api referred as sharex format

tmpfiles api

transfer.sh

gofile.io

nopaste.net with curl and netcat endpoint

不支持api 需要探索

privfile with download limit

helix

tempd.link

Read More

2022-10-25
B站根据视频内容自动生成推荐的标签

B站允许最多10个标签

不能发布太频繁, B站官方限制30秒一稿

some upload api

this api does not analyze the video content. it only predict tags from metadata:

https://member.bilibili.com/x/web/archive/tags

how to get upload_id

只有PC网页端有这个 手机端没有 可能是新功能

b站最新更新了这两个接口 需要传入upload_id 具体参数抓包获取

分区推荐 POST:

https://member.bilibili.com/x/vupre/web/archive/types/predict

标签推荐 GET(可能有延迟 需要请求两次 因为第一次标签数量较少):

https://member.bilibili.com/x/vupre/web/tag/recommend

获取活动标签:

https://member.bilibili.com/x/vupre/web/topic/type?type_id=21&pn=0&ps=200&title=20210210_298667075925_waou_5s&t=1667530591393

Read More