Remix.run Logo
bodantogat 4 hours ago

I feel the pain — it’s very difficult to detect many of the less ethical scrapers. They use residential IP pools, rotate IPs, and provide valid user agents.

everybodyknows 43 minutes ago | parent | next [-]

> residential IP pools

So, is this a new profit center for sleazeball household ISPs?

ranger_danger 4 hours ago | parent | prev [-]

And many proxy/scraping providers now use real browsers that can automatically bypass cloudflare captchas as well, and a bot with a real browser similarly won't be clicking on any invisible links, so... I am skeptical just how long this will make an appreciable difference.

trollbridge 4 hours ago | parent [-]

So what you’re saying is that a CAPTCHA cannot actually T C and H A.