Remix.run Logo
ncruces 6 days ago

It's not random internet people saying it's training. It's Cloudflare, among others.

Search for “A graph of daily requests over time, comparing different categories of AI Crawlers” on this blog: https://blog.cloudflare.com/ai-labyrinth/

johnea 6 days ago | parent [-]

In the feed today:

AI crawlers and fetchers are blowing up websites, with Meta and OpenAI the worst offenders

https://www.theregister.com/2025/08/21/ai_crawler_traffic/