| ▲ | VladVladikoff 3 hours ago | |
In my experience, not really. Each asset is made by a new proxy, eg some TV somewhere, they send every new request via a new IP address, which is a new machine, and it doesn’t matter how long the response takes, they have already rotated to the next ip immediately and sent another request. Most of these providers have millions of IPs, and it generally doesn’t take millions of requests to scrape a website (unless it’s really big!) | ||
| ▲ | inigyou 3 hours ago | parent [-] | |
And each new IP triggers a new Anubis challenge. Isn't it great? | ||