Remix.run Logo
lukewarm707 4 days ago

happy to offer a counter of some great products for anti-bot defeat:

https://brightdata.com/

https://www.zenrows.com/

https://www.capsolver.com/

https://scrapfly.io/

hundreds of millions of residential ips, human browser fingerprints, custom browser binaries, auto solve of turnstyle, recaptcha v3, kasada, datadome, AWS WAF, etc if they come up.

cjbarber 4 days ago | parent [-]

Bright Data ranks #1 on Foil's leaderboard [1], but is still detected. ScrapFly is #4 and ZenRows #7. And I guess Capsolver isn't really a scraping thing but is more just for the captcha component.

I think it'd be good if there were more products that did a better job of making an actually undetectable agent, but doesn't seem like any exist yet.

[1]: https://usefoil.com/research/stealth-browser-leaderboard

lukewarm707 2 days ago | parent | next [-]

so, i found out why foil detects all the bypass products and the others fail badly:

it costs $0.05 per bot check

lukewarm707 4 days ago | parent | prev [-]

i guess more people should use foil...big recaptcha, cloudflare challenge/turnstyle etc is 95+% bypassed, take your bets on how long this new cloudflare holds out