Qwen 3.8 27B defaults to "xhigh" (its maximum level) for thinking, which makes it diabolically slow. Setting it to "medium" or "low" speeds it up a lot.

▲

dofm 5 hours ago | parent [-]

It does. It's quite good with the low setting. I prefer Muse Glimmer for, I dunno, hard to explain comfort reasons.

I had to hack the template of Qwen 3.8-27B to get it to go into low reasoning mode. Not sure if that is fixed.

Have you tried Nemotron 74B-9B? (Slow on Mac with llama.cpp due to a missing tensor type)

▲

electroglyph 4 hours ago | parent [-]

that nemotron model is such a dog, like all the other nemotrons

	▲	dofm 3 hours ago \| parent [-]
		I have found it to be OK on sort of general purpose overview code stuff. At the moment it's too slow in llama.cpp on Mac for me to bother testing further.