Remix.run Logo
ece an hour ago

Every website that wants to, can just charge for dumps. Anubis or even Cloudflare can handle the rest I think.

Symbiote an hour ago | parent [-]

Scrapers will ignore the dumps.

You can link to them in 10 million HTTP 429 responses, they will still ignore them.

ece 13 minutes ago | parent [-]

Those scrapers can be blocked. Some scrapers won't ignore the responses, and maybe it'll lead to a meaningful reduction in scraping traffic.