2022-07-14
Harmonyos Device Log To Mysql

mysql path:

jdbc:mysql://10.33.163.33:3306/HTS_DB?characterEncoding=UTF-8

root

pipeline@123

Logs Path:

/data/data/Local/DeviceTest/20220406163617_hts_project/resources/HTS/android-hts/logs

under logs:

%Y.%m.%d_%H.%M.%S_

select the latest folder

under selected folder:

device_logcat_test__.txt.gz

decompress using: (before that os.chdir to the selected folder)

gzip -d

does the decompression remove the .gz file?

it will.

log format per line:

DfxTestLog: A1__DfxTestTime = datai=4

from 1 to 13:

A1test1..4

A2test5

A3test1..2

B1test1

B2test4..6

D1test1

M1test1

Tables:

Performance_Baseline_Info

testValue date(%Y-%m-%d) hmsVersion(HMSCore660319) baselineId_id deviceId_id(1,2,4,3,5) deviceType(phone<-1|wearable<-2|car<-4|tv<-3|ecodevice<-5)

Performance_Daily_Data

id features indicators baseValue

Performance_Device_Info

id(to the deviceId_id) model type sn cpu

Read More

2022-06-27
SpeedUp Tujia Scraping

Find which request sets the cookie, then do all other requests using DIRECT, route only that request to GLOBAL.

Read More

2022-06-09
Remote Jobs

remote jobs in china:

https://github.com/LinuxSuRen/remote-jobs-in-china

remote jobs from stack overflow:

Read More

2022-06-05
途家Scraping Api

搜索api 先通过fetch的api获得不同的限制条件

从0开始 最多58页 每页30个 相同条件最多爬1740个 可以倒序排序来翻倍 可合并其他排序来收集更多

用地区做限制 加上价格限制 或者加更多限制 使得总数少于1740*2=3480 用启发式策略 如果实在超过了预设限制不管了直接开始爬 这种策略可能没法暂停继续爬取

Read More

2022-02-22
Mindmap

需求:对目前做出来的共现网络图谱进行社区划分,使用简单的谱聚类方法就行,要求能看出来图谱热点被区分开,最后的结果通过图谱的形式展示。

Read More

2022-02-21
Movie Scraping 3

https://www.dianyinggou.com

with douban link

Read More

2022-02-20
Movie Scraping 2

Read More

2022-02-18
English Courseware Scraping

imman.ireadabc.com 账号:13408602063 密码:602063 按目录下载所有视频

init_url = “https://imman.ireadabc.com

this url will not change at all.

username = “13408602063”

password = “602063”

main_url = “https://iteachabc.com/airclass_imman

https://iteachabc.com/imman/login?acsid=8974dc67-b02e-4f0d-a83f-a03cbe6f7fe4

91reading.com 账号:jpa 密码:602063 按目录下载所有课件

Read More

2022-02-18
Library System

Read More

2022-02-17
Movie Site Scraping 1

https://www.zxzj.fun/ 目标站

采集1.电影名或是电视剧名要区分是电影还是电视剧,2上映时间,年限即可 3.播放链接

2506004169@qq.com

https://www.zxzj.fun/list/1.html

from 1 to 6.html

query:

https://www.zxzj.fun/vodshow/1-----------2022.html

https://www.zxzj.fun/vodshow/1--------2---2021.html

https://www.zxzj.fun/vodshow/4-----------2022.html

Read More