data storage

you can configure K3S_DATA_DIR environment variable during installation

first, stop all k3s services

1
2
3
4

# run with root
systemctl stop k3s # k3s-agent otherwise
k3s-killall.sh

copy the data to new location

1
2

rsync -avh --progress /var/lib/rancher/k3s <path_to_store_data>

then modify the service file under /etc/systemd/system/k3s.service or /etc/systemd/system/k3s-agent.service, add one additional flag --data-dir <path_to_store_data> to the commandline

restart the service after done

1
2
3

systemctl daemon-reload
systemctl start k3s

select targets for scraping. it could be your browsing history, package indexs, social media (dynamic contents, with different accessing methods than web scraping)

if not accessible, access it with proxies, cookies.

finally store the content into compat and usable formats, categorized and linked