Remix.run Logo
▲ UncleOxidant 2 hours ago

> Qwen-3.8-27B - the best thing that happened in AI so far.

Qwen3.8-Flash_Next should be in the running for that title as well. It's astonishingly good. I use both of them. If I need more memory on the machine for other things I run 27B, If I can get by with much less RAM I run QFN (takes about 102GB on my Strix Halo box with 262,144 context). QFN runs quite a bit faster on my hardware - about 50t/s. 27B with MTP starts out around 22t/s but degrades over time as the context fills up. Both are great models, but I'd give QFN a bit of an edge (at least for the coding projects I've worked on). But both feel on par with Claude Opus 4.6 - 4.8.

▲simonw an hour ago | parent | next [-]

Apparently Qwen 4 might land this week, and it uses the same architecture as 3.8-Flash-Next (so various LLM serving tools should be able to handle it already). I'm hoping Qwen 4 includes some smaller models - the last 4B and 9B from Qwen were for 3.5.

▲bityard an hour ago | parent | prev | next [-]

Which quant of QFN are you running on your Strix Halo?

HF is telling me that IQ4-XS is the largest one likely to fit without much contortion.

▲justinclift an hour ago | parent | prev [-]

> Qwen3.8-Flash_Next should be in the running for that title as well.

Unfortunately it still hallucinates, which limits it's usefulness for real world tasks. :(

▲bityard an hour ago | parent [-]

Every model hallucinates, if not given the right context and tools.