Remix.run Logo
Remix clone Hacker News
new | show | ask | jobsGithub
▲ Foobar8568 5 hours ago

But Qwen 3.8 27b is unbearable slow, you get 10minutes of "let me think" over any trivial stuff.

▲simonw 5 hours ago | parent [-]

Qwen 3.8 27B defaults to "xhigh" (its maximum level) for thinking, which makes it diabolically slow. Setting it to "medium" or "low" speeds it up a lot.

▲dofm 5 hours ago | parent [-]

It does. It's quite good with the low setting. I prefer Muse Glimmer for, I dunno, hard to explain comfort reasons.

I had to hack the template of Qwen 3.8-27B to get it to go into low reasoning mode. Not sure if that is fixed.

Have you tried Nemotron 74B-9B? (Slow on Mac with llama.cpp due to a missing tensor type)

▲electroglyph 4 hours ago | parent [-]

that nemotron model is such a dog, like all the other nemotrons

▲dofm 3 hours ago | parent [-]

I have found it to be OK on sort of general purpose overview code stuff. At the moment it's too slow in llama.cpp on Mac for me to bother testing further.