You still need the hardware

I've got a 128GB strix halo staying warm at home, it has nothing on top models with big budget. It's good supplement to low end plans for offloading grunt work / initial triage

▲

manmal 3 hours ago | parent [-]

Have you looked into DwarfStar 4?

▲

__s 2 hours ago | parent [-]

Been away from home for nearly a month, so was mostly going off Qwen 3.5 122b-a10b (Q4?) / Qwen 3.6 35b-a3b (Q8) / Gemma4 31b (Q8)

Thanks for suggestion tho, tool by antirez is always going to pique interest, I'll check it out when I'm finally home again

Tho says Metal / CUDA, so doesn't seem friendly to Linux AMD system

	▲	manmal 41 minutes ago \| parent [-]
		His quant that fits into 128GB looks interesting for Spark DGX as well IMO.