my prediction: ai agents will have their day, but not on this version of the web. websites will have a separate xml/json/yaml version that agents can peruse without all the ads/js/etc

▲

likium 2 hours ago | parent | next [-]

Isn't that just API? We had them. Reddit/Zillow/Wells Fargo/etc restricted theirs due to business reasons, not technical ones.

▲

wpm 2 hours ago | parent | prev | next [-]

My agents can just take that feed and render it into a custom front end just for me too. Why would I browse the adversarial, bloated, ad infested version?

▲

mft_ an hour ago | parent | prev | next [-]

I agree. I’ve been saying for years that marketing teams need to switch to include marketing to LLMs.

I have (currently free but maybe paid in the future) accounts for side projects with businesses that Claude chose for me. (I reviewed the suggestion, but didn’t see a problem or reason to change it.) Why did Claude choose those providers? No idea, but if it’s through subtle marketing to Claude, then well done to them.

▲

tracerbulletx 2 hours ago | parent | prev | next [-]

Why would that happen if the website owners are explicitly trying to prevent access? This isn't a technical issue, the agents are perfectly capable of working with the existing websites regardless of ads and javascript. The semantic web and machine readable representations was a 90s thing, agents don't need that really.

	▲	zzzeek 2 hours ago \| parent [-]
		the js/yaml version would require a license key that connects to a business arrangement between the website and the owner of the crawler. the plain HTML version would adversarially block them (or even identify them, where they could be sued...once we have legal precedents for this stuff).

▲

whimsicalism 2 hours ago | parent | prev | next [-]

hm. for me, AI agents effectively already have their day unless there is a retrenchment. i essentially do not interact with the web (outside of a few social media sites) anymore

▲

my-huge-pony 2 hours ago | parent [-]

>i essentially do not interact with the web

Grim. No point in writing blog posts or publishing anything for free if that's the future.

	▲	Kim_Bruning an hour ago \| parent \| next [-]
		There IS actually. In my case I'll look at a site if an agent says it's good!
	▲	dageshi an hour ago \| parent \| prev [-]
		Yeah the web is done, youtube is probably the only place worth publishing to now.

▲

morkalork 2 hours ago | parent | prev [-]

Without the ads? The pessimist in me thinks with all the ads, prompt injections, and long-form content marketing included. Already you can see Google's AI results rehashing marketing slop in the answers about how amazing one product or another is.

Wasn't there some restaurant review site that gets accused of doing pay-to-play hiding of negative reviews and promoting positive ones that calls up businesses and basically extorts them into their services? They have all the incentive in the world now to manipulate the results shown to AI agents. You won't even see the manipulation directly yourself when there's an AI sitting between you and the source acting like an obfuscation layer.