Web Scraping Logic

Web scraping is the process of extracting data from websites by selecting targets and utilizing proxies or cookies for access, storing the content in compatible formats, categorizing it, and linking it for efficient retrieval.

---

select targets for scraping. it could be your browsing history, package indexs, social media (dynamic contents, with different accessing methods than web scraping)

if not accessible, access it with proxies, cookies.

finally store the content into compat and usable formats, categorized and linked