What are you running at home, out of interest?

While I cautiously circle the AI programming concept, one thing close to my mind has definitely been whether the ultimately cloud-tied nature of it is what makes me much more stand offish to it.

▲

kodoman 2 hours ago | parent | next [-]

I am GPU poor and have a piece of crap rx570 8GB but still get ok performance out of qwen3.5-9B-4bit and various fine tuned versions. Plan on finally buying a decent gpu like a amd 7900 xtx. I still use claude for coding primarily but do research locally. What everyone has said about qwen3.8 though is making me feel I really need to invest in a decent rig.

▲

vrganj 2 hours ago | parent | prev [-]

Not the parent, but I'm enjoying Qwen 3.8 27B on my Strix Halo machine.

	▲	Zambyte 2 hours ago \| parent [-]
		Also running Qwen 3.8 27b, on a 7900 XTX. I've been able to comfortably do a large majority of my programming locally since about Qwen 3.5. I also use pi.dev as my agent harness, and ollama as my inference engine. Though I've been considering switching out the latter for something else, since the main advantage of ollama is the ease of switching models, which I don't really do often anymore.