| ▲ | eru 5 hours ago | |
Well, Claude Cod and Codex should be doing most of their heavy lifting in the cloud? | ||
| ▲ | amonith 5 hours ago | parent | next [-] | |
Sort of, they have no "hands", LLMs can only respond that they want to execute a tool/command. So they do that a lot to: read files, search for things, compile projects, run tests, run other arbitrary commands, fetch stuff from the internet etc. Obviously the LLM inference is super heavy, but the actual work / task at hand is being executed on the device. | ||
| ▲ | coldtea 4 hours ago | parent | prev | next [-] | |
The AI part yes. But they also use quite inefficient rendering on the cli. | ||
| ▲ | exe34 4 hours ago | parent | prev [-] | |
yeah I run Claude code on a 2013 Mac book air that refuses to die, I don't think it's very compute heavy. | ||