Remix.run Logo
vineyardmike 2 hours ago

No.

Computer use (to anthropic, as in the article) is an LLM controlling a computer via a video feed of the display, and controlling it with the mouse and keyboard.

chasd00 2 hours ago | parent | next [-]

> controlling a computer via a video feed of the display, and controlling it with the mouse and keyboard.

I guess that's one way to get around robots.txt. Claim that you would respect it but since the bot is not technically a crawler it doesn't apply. It's also an easier sell to not identify the bot in the user agent string because, hey, it's not a script, it's using the computer like a human would!

dbbk 2 hours ago | parent | prev | next [-]

That sounds weird. Why does it need a video feed? The computer can already generate an accessibility tree, same as Playwright uses it for webpages.

0sdi an hour ago | parent | next [-]

So that it can utilize gui and interfaces designed for humans. Think of video editing program for example.

dbbk 15 minutes ago | parent [-]

Yes. GUIs expose an accessibility tree.

lsaferite an hour ago | parent | prev [-]

I feel like a legion of blind computer users could attest to how bad accessibility is online. If you added AI Agents to the users of accessibility features you might even see a purposeful regression in the space.

cowboylowrez 2 hours ago | parent | prev [-]

oh hell no haha maybe with THEIR login hahaha