Remix.run Logo
▲ jononor 3 hours ago

Above GLM 5.3, nice! That is a very capable model. I do wish that we will see some smaller "flash" models again though - running this one locally is tough (very costly).

▲LaurensBER 3 hours ago | parent | next [-]

For comparison, close to Opus 5. Far behind Sol 6.1 and Opus 5.5.

Probably a pretty decent model for 90% of the usecases!

I've been doing a lot of hobby work with GLM 5.3 Flash and I can count the amount of times that I need a stronger model on two hands.

I have access to unlimited tokens at works and Opus is great but also often overkill if you know exactly what you need.

▲egeozcan 2 hours ago | parent | next [-]

I use Opus for planning, through API on medium thinking, it doesn't cost anything significant and the rest can be happily done with deepseek or glm flash. Using sol 6.1 for review loops at the end. All running on pi.

A very complex task tends to cost like 10$ max. It's comparable to a subscription with enormous flexibility.

It's a steal.

▲cromka 27 minutes ago | parent | prev [-]

Honestly, I don't know what people see in Sol 6.1. Opus 5.5 is so much more inteligent, as in proactive, avoiding stupid mistakes, where it contradicts itself, ignores the context. Sol 6.1 has a gold-fish memory, it's as annoying for me to work with as Opus 5 was.

▲cjbgkagh 17 minutes ago | parent [-]

You can override the context length of Sol to 1M

▲minraws an hour ago | parent | prev | next [-]

By next year we will likely see GLM 5.3 level performance in Qwen 4 MoE models that can run on most higher end consumer systems.

I don't think there is a reason to care about any of it, just get a few dollars on a few openrouter or similar platforms and just use the models for now, wait for cheaper models that are good enough for you to become available for your hardware.

Sure you might never see frontier performance on consumer hardware but do you really need that though? Does anyone? And if you ever do just get a 30-day sub for that work, and cancel it.

▲Pragmata 2 hours ago | parent | prev [-]

Cant you run it on a pair of DGX spark? Sure it's expensive now, but at the initial retail price that was what, 8k in hardware? Not exactly unachievable

▲bashtoni 2 hours ago | parent [-]

No, this is not a small model. I believe 4x Sparks is possible but 4.1 is pretty big for a flash model.

MiMo 2.6 Flash is the most capable model you can currently run on 2x Sparks without resorting to a quantised version of something.

▲Pragmata 2 hours ago | parent [-]

I meant quantized. You can get an EXL3 quantized version thats almost the same performance.

▲bashtoni 35 minutes ago | parent [-]

My experience running quantised models is that they look the same at first but are all noticeably worse once the context size gets beyond anything trivial.