Honestly, you're missing out. The productivity gains I've had with these tools is unbelievable. I understand the risk though, so if you've got government sensitive data on your computer, or no backups, don't use the "full access" option. Babysit what it does instead.

▲

dmortin 3 hours ago | parent | next [-]

Isn't it expensive, though? If you let it perform gui or web tasks for you using vision, I'd think it consumes lots of tokens.

	▲	Closi 2 hours ago \| parent \| next [-]
		Depends how much you are using it - for a casual user the $20 tier gives you just about enough use for hobby projects etc. Or if you are doing full time development then you just need to pony up for the 20x tier if you want to use it. Running Codex locally removes so much friction and is so fast compared to either running it on the web (where it has to build environments online etc which consumes time) or compared to copy-pasting chatgpt that it's just a no-brainer.
	▲	zorked 2 hours ago \| parent \| prev [-]
		I don't know about Chatgpt but I used Kimi (they have a Chinese-only plugin that does desktop control - works fine if you enable it even if you don't know Chinese). Observing how it works, it's mostly using the accessibility features of the user interfaces - it fetches a sort of DOM for the desktop applications. Only rarely it has to take a screenshot.

▲

margorczynski 3 hours ago | parent | prev [-]

Can you give some examples? I'm evaluating where/how I could use stuff like this.

▲

vineyardmike 3 hours ago | parent | next [-]

Literally everything from generic coding agent to shopping.

I run it in a MacOS vm, fwiw, for certain tasks. I usually hand it a repo and say “install all build dependencies” and it’ll click through installation GUIs where necessary. I wonder if the TOS of an application is enforceable if a bot agreed and a human never saw it.

It can UI test web apps if that’s part of your job, but it can also just use the browser for tasks. I’ve had it research flights by checking different dates automatically and compiling the results for me. I’ve heard others use it to handle building a shopping cart for instacart/grocery delivery.

Probably the hero usecase for most people would be app/web development. It can control either a browser or a device simulator and can iteratively build and test the application, by clicking real buttons.

▲

shevy-java 3 hours ago | parent [-]

> Literally everything from generic coding agent to shopping.

People need help with shopping now?

	▲	ccozan 2 hours ago \| parent [-]
		ooh, chatGPT is really good in filtering bullshit and recommending the products that really fit. For serious stuff, is part of the shopping flow.

▲

WASDx 3 hours ago | parent | prev [-]

I upgraded my workflow a few months ago from "copy-paste things in and out of ChatGPT" to "use an agent that edits my project files and runs tests on its own" and the ergonomics are just so much better and enables automating bigger tasks. I still monitor everything it does and do manual adjustments so I feel ownership of the code.

▲

margorczynski 2 hours ago | parent [-]

But isn't that use-case solved a harness like OpenCode or Codex? OpenClaw and Hermes are a bit different beast although they can also be used for development in a more holistic manner (e.g. automated GUI testing).

I'm just wondering about other uses where such a system would be useful aside from asking it via Signal or WA for the weather.

	▲	WASDx 2 hours ago \| parent [-]
		Right. I'm also curious about those use cases. I don't want an AI clicking through my mailbox.