| ▲ | gwerbin 10 hours ago | |
Either they're running Claude Code with a local LLM (technically possible via dev tools albeit unsupported), or they genuinely have no idea why the Mac is good for AI and just bought it because they were told it was good for AI. The former honestly sounds like a nightmare because the Mac Mini can run some big models but not that big, and Claude Code will guaranteed stuff your context with 35k tokens, and all the Anthropic proprietary tool-deferral and tool-search stuff is meant to be handled inside the inference engine in a way that I don't think any open-source engine like vLLM can support right now (much as I wish it did). So you have a huge context on startup, broken functionality, and an underpowered LLM struggling through it all. Not to mention I have no idea how any of the sidecar LLM stuff is meant to work in that context (e.g. auto-mode classifier and even things like dynamic session naming). Am I missing something? I don't want to assume it's the latter, I want to be charitable to other people. But. | ||
| ▲ | aurareturn an hour ago | parent [-] | |
You’re just plain wrong. I use Claude Code subscription through my Mac Mini when I’m on the go. | ||