| ▲ | ihuman 4 hours ago | |||||||||||||
There's a difference between someone running a scraping tool occasionally and bots constantly and rapidly re-scraping the same site over and over again | ||||||||||||||
| ▲ | Lalabadie 4 hours ago | parent | next [-] | |||||||||||||
The author's website is responsible for storing its own data. AI services currently treat the entire web as their storage and cache layer. | ||||||||||||||
| ▲ | qbane 4 hours ago | parent | prev [-] | |||||||||||||
This is an important context: the site is more likely to be targeted by scrapers because it is a curated collection of scraped information. | ||||||||||||||
| ||||||||||||||