| ▲ | seizethecheese 3 hours ago | |||||||||||||
I hope they are able to serve 4 faster. Qwen 3.8 is a great model but I’ve regretted including it in the battle system for opencode [1] we have been building because it scores so low. And it’s a shame because the only reason it scores so low is that it’s slooooow. (Like 30 tokens per second vs opus near 80.) If you exclude voting, Qwen 3.8 does well. (We allow early voting contrary to Arena.ai because I think it makes sense for agents, where it doesn’t for chat. This means our data takes speed into account.) Also, it would be ideal if they served this with third parties. Part of the slowness with 3.8 is just not a lot of providers. Their open source version is much faster, but we couldn’t include it because it doesn’t handle images (another own goal by Alibaba). | ||||||||||||||
| ▲ | jakswa an hour ago | parent | next [-] | |||||||||||||
In case it translates to Qwen 4 27B, I've been running Qwen 3.8 Flash Next (which while MoE (and bigger) is supposed to be a preview of Qwen 4's architecture) and it runs pretty solidly regardless of context window size and completes random deepswe challenges I throw at it locally (at Q2-Q3 quantization! so it fits on my shitty setup). | ||||||||||||||
| ▲ | FrostKiwi an hour ago | parent | prev | next [-] | |||||||||||||
> but we couldn’t include it because it doesn’t handle images Maybe I'm mixing up model variants, but Qwen 3.8 27B that I run locally totally does handle images. Surely the bigger one would as well? | ||||||||||||||
| ||||||||||||||
| ▲ | 26 minutes ago | parent | prev | next [-] | |||||||||||||
| [deleted] | ||||||||||||||
| ▲ | forgingahead 2 hours ago | parent | prev [-] | |||||||||||||
Qwen3.8 doesn't handle images? | ||||||||||||||
| ||||||||||||||