This is what reader mode is. It exists purely because most websites are unreadable.

Big fan of reader mode. For me, a direction better than llms.txt would be to encourage sites to improve their markup (think semantic web era) so agents could get the text version from that the way reader mode does. Would achieve the same thing - save tokens.

This isn't difficult and I think the reason it hasn't been done is that publishers want clicks and ad views. Which begs the question: why would they start doing it for agents?

▲

fullstackchris 32 minutes ago | parent | next [-]

modern agents already do this via content negotiation and will attempt to retrieve the markdown version of a given site

https://www.sanity.io/learn/course/markdown-routes-with-next...

▲

0-_-0 3 hours ago | parent | prev [-]

Agents don't buy stuff they see in an ad

▲

Retr0id 3 hours ago | parent [-]

So why serve them at all?

▲

Gigachad 2 hours ago | parent [-]

If your website itself is advertising a product or service you sell you would still want LLMs to see and fetch it. If you are a news site, blog, or any other website that doesn’t exist to sell something, you are only harmed by ai agents.

	▲	Retr0id 2 hours ago \| parent [-]
		In those situations you wouldn't have ads on the human version of the site either, surely?