| ▲ | UncleOxidant 2 hours ago | |||||||
> Qwen-3.8-27B - the best thing that happened in AI so far. Qwen3.8-Flash_Next should be in the running for that title as well. It's astonishingly good. I use both of them. If I need more memory on the machine for other things I run 27B, If I can get by with much less RAM I run QFN (takes about 102GB on my Strix Halo box with 262,144 context). QFN runs quite a bit faster on my hardware - about 50t/s. 27B with MTP starts out around 22t/s but degrades over time as the context fills up. Both are great models, but I'd give QFN a bit of an edge (at least for the coding projects I've worked on). But both feel on par with Claude Opus 4.6 - 4.8. | ||||||||
| ▲ | simonw an hour ago | parent | next [-] | |||||||
Apparently Qwen 4 might land this week, and it uses the same architecture as 3.8-Flash-Next (so various LLM serving tools should be able to handle it already). I'm hoping Qwen 4 includes some smaller models - the last 4B and 9B from Qwen were for 3.5. | ||||||||
| ▲ | bityard an hour ago | parent | prev | next [-] | |||||||
Which quant of QFN are you running on your Strix Halo? HF is telling me that IQ4-XS is the largest one likely to fit without much contortion. | ||||||||
| ▲ | justinclift an hour ago | parent | prev [-] | |||||||
> Qwen3.8-Flash_Next should be in the running for that title as well. Unfortunately it still hallucinates, which limits it's usefulness for real world tasks. :( | ||||||||
| ||||||||