Remix.run Logo
▲ seizethecheese 3 hours ago

I hope they are able to serve 4 faster. Qwen 3.8 is a great model but I’ve regretted including it in the battle system for opencode [1] we have been building because it scores so low.

And it’s a shame because the only reason it scores so low is that it’s slooooow. (Like 30 tokens per second vs opus near 80.) If you exclude voting, Qwen 3.8 does well.

(We allow early voting contrary to Arena.ai because I think it makes sense for agents, where it doesn’t for chat. This means our data takes speed into account.)

Also, it would be ideal if they served this with third parties. Part of the slowness with 3.8 is just not a lot of providers. Their open source version is much faster, but we couldn’t include it because it doesn’t handle images (another own goal by Alibaba).

[1]: https://agentduel.com/leaderboard

▲jakswa an hour ago | parent | next [-]

In case it translates to Qwen 4 27B, I've been running Qwen 3.8 Flash Next (which while MoE (and bigger) is supposed to be a preview of Qwen 4's architecture) and it runs pretty solidly regardless of context window size and completes random deepswe challenges I throw at it locally (at Q2-Q3 quantization! so it fits on my shitty setup).

▲FrostKiwi an hour ago | parent | prev | next [-]

> but we couldn’t include it because it doesn’t handle images

Maybe I'm mixing up model variants, but Qwen 3.8 27B that I run locally totally does handle images. Surely the bigger one would as well?

▲seizethecheese an hour ago | parent | next [-]

The model I’m referring to that would be faster and similar size, but doesn’t handle images is Qwen 3.8 2.4T: https://openrouter.ai/qwen/qwen3.8-2.4t-a95b. It’s weird that this is pretty much the same as Max but doesn’t support images. No idea why.

▲ an hour ago | parent | prev [-]
[deleted]
▲ 26 minutes ago | parent | prev | next [-]
[deleted]
▲forgingahead 2 hours ago | parent | prev [-]

Qwen3.8 doesn't handle images?

▲seizethecheese 2 hours ago | parent [-]

Sorry that was confusing. Qwen 3.8 2.4T is faster than what we have on leaderboard but it doesn’t handle image input: https://openrouter.ai/qwen/qwen3.8-2.4t-a95b