Remix.run Logo
rvz 2 days ago

Imagine playing the AI agent and scraper cat-and-mouse game all for Cloudflare to block them all by default all to navigate web pages and waste millions worth of tokens just to operate a computer.

The move by Cloudflare will totally ruin the AI scraper and the AI agent hype.

oceanplexian 2 days ago | parent | next [-]

I don’t see how CloudFlare is going to realistically block someone who is trying hard enough.

They’ll just get the agent to operate a browser with vision and it’s over. CAPTCHAs were already obsolete like 2-3 years ago.

rsanek 2 days ago | parent [-]

they don't have to make it impossible, just expensive enough for it to not be worth it. using vision is a perfect example.

OccamsMirror 2 days ago | parent | prev | next [-]

The funny thing is that a lot of people want the AI to scrape their public website. The same people that likely wrote all of their marketing content with ChatGPT.

iphone_elegance 2 days ago | parent | prev [-]

Eh, if you control the browser or provide a good plugin you can just have users scrape for you