For those concerned with making sure end-users have access to working user-agents moving forward:

I'd focus on using accessibility and other standard APIs. Some tiny fraction of web pages will try to sabotage new applications, and some other fraction will try to somehow monetize content that they normally give away for free, or sell exclusive access to centralized providers (like reddit did). So, admitting to being a bot is going to be a losing strategy for AI agents.

Eventually, something like this MCP framework will work out, but it'd probably be better for everyone if it just used open, human accessible standards instead of a special side door that tools built with AI have to use. (Imagine web 1.0 style HTML with form submission, and semantically formatted responses -- one can still dream, right?)