Remix.run Logo
▲ viraptor 6 hours ago

> There actually is such a thing as verified bots on Cloudflare that gets through most blocks

Verified bot is just a label. What you do with that information is entirely up to you as the operator. It doesn't say anything anything about the service and doesn't provide any guarantees about the traffic.

▲weird-eye-issue 5 hours ago | parent [-]

No it's not just a label because it's a category that gets used in the firewall settings. A lot of sites allow only verified bots and block non-verified ones. So yes as I already mentioned website owners can of course block verified bots but it's much much less common than blocking non-verified ones because most site owners don't want to accidentally deindex their site from Google...