I'd rather have a site showing how well my site is protected from being accessed by AI agents would be preferable, and advises how I can lock it down further. Basically, the exact opposite of this.

▲

tkmcc 3 minutes ago | parent | next [-]

I am building a product to help with this, please write me (email in profile), I would love to hear more about what you're trying to protect.

▲

celso 2 hours ago | parent | prev | next [-]

You might want to take a look at AI Crawl Controls https://developers.cloudflare.com/ai-crawl-control/

▲

pickleglitch 2 hours ago | parent [-]

I might, except I don't, because fuck Cloudflare.

	▲	dormento 12 minutes ago \| parent [-]
		Last night I had a nightmare about cloudflare finally monetizing the "making sure you're not a robot" page. AI agents got the information they needed, we got ads instead ("why are you here? You're supposed to let agents do the thing. Watch some ads instead"). I woke up with such a bad feeling..

▲

gosub100 an hour ago | parent | prev [-]

Maybe we can start a new protocol where the html is encrypted, and the viewer must try 2^10 to 2^20 hashes before the decryption key is discovered. Same formula that BTC mining uses. It would be negligible cost for any single user but terribly expensive for crawling en-masse.

▲

ablob an hour ago | parent | next [-]

Anything that increases the entry time by a second or more is a pretty good way to make me (and probably others) just not bother with opening the website.

	▲	throw-the-towel 18 minutes ago \| parent \| next [-]
		Just removing a couple of ad scripts would probably get the loading time back where it was.
	▲	snailmailman 41 minutes ago \| parent \| prev [-]
		Usually the Anubis anti-bot things only take a second. But I stared at one for more than 30 seconds the other day when I tried to access one of the Linux kernel websites. Literally just a progress bar with a hash counter. I was on a modern iPhone, I don’t know why it took so long. maybe because my phone had low battery? But it’s infuriating that this is what the web has become. The web is becoming more and more unusable every day. If your data is easy to access, it gets stolen and scraped, your site effectively DDOSed. If your site is hard to access nobody will visit.

▲

saintfire 39 minutes ago | parent | prev [-]

This is how Anubis operates, to some extent. The more suspicious your connection is, the harder and more frequent the proof of work.

The latency while browsing the web these days is brutal as a result; between Anubis and Cloudflare and the like.

Our prize for it will be the impending super intelligence our benevolent future overlords allow us to exploit, I suppose. /s