Remix.run Logo
hedora 4 hours ago

Time to dust off my 128GB strix halo (literally—it’s been dusty, and it’s running a bit warm these days).

Any idea where this model sits according toquality benchmarks? Pre-bubble MSRP on this hardware was $1400, and it draws 200-ish watts, putting it down into consumer territory.

I’m wondering if it can replace claude for llm-friendly coding tasks.

cpburns2009 4 hours ago | parent [-]

So back in the Qwen 3.5 release, the 122B-A10B model scored slightly better than the 27B model. I'd expect this new 125B-A6B to perform similarly to the recently released 27B. Qwen3.8 27B is supposed to rival Sonnet/Opus 4.6.

hugmynutus 3 hours ago | parent | next [-]

Qwen3.8/Qwen3.6 has a weird self doubt/thinking too much problem. You can prompt it away. I would say it "approximates" Opus 4.X class models well enough especially for coding/linux problems.

The only reason I stopped using it as much is I was getting 25-35tok/s on Intel B70 (non-quant) which made some responses slow. For a long running/autonomous task, it would probably be sufficient.

wongarsu 3 hours ago | parent | prev | next [-]

There is the rule of thumb that if you take the geometric mean of the total and active parameters of an MoE model you get the equivalent size of an equally capable dense model.

If you follow that formula, you would expect a 125b-a6b model to match a 27b model (sqrt(125*6) = 27.3). That does not feel like a coincidence

hedora 4 hours ago | parent | prev | next [-]

Thanks. My current stack ranking of anthropic models is:

4.6 ~= 4.8

4.7 much worse.

Fable and newer consistently tells me to pound sand, so I’m not sure what I’m paying $200/month for. 4.8 sometimes does too, but it’s at least usable most of the time.

So, I’d expect this to mostly replace Claude for my workflows. The main tradeoff for me should mostly be token throughput vs. no longer really trusting anthropic.

cyanydeez 3 hours ago | parent | prev [-]

I've got the A10B hooked up to deer-flow and it does remarkable well when you dont need to baby sit it.