Remix.run Logo
▲ dofm 6 hours ago

Yeah. I didn't find these any good either.

However, Gemma 4 26B is a reasonably good general chat inquiry model (it's also not too bad at commonplace code questions, if not as good for agentic code).

So this could be a good, fast model for that, in some situations; I may test it.

I still broadly just prefer working with Muse Glimmer, to be honest; we get along OK. I am trying out the Nemotron Bolt 74B/A9B MoE and I really do think it could be quite good, but it's still slow on Metal.

▲solarkraft 5 hours ago | parent [-]

> I still broadly just prefer working with Muse Glimmer

Welcome to our very exclusive club of now two people! Ever since it came out I’ve been trying to find a better model, but just can’t.

▲dofm 5 hours ago | parent [-]

It is hard to explain why it is better. Benchmarks etc., context length, it should be worse than Qwen 3.8 27B and I am sure for long context work it is.

But on my old M1 Max, with "Reasoning strength: low" in the system prompt, it's just kind of nice to use. It's not really slow (despite being a dense model it is faster to actual solutions than the Qwen 3.6 35B MoE), it writes well, etc.

So I use it as a developer-friend and researcher at the moment. Though it is actually the only model I've deployed code from! In general I am still writing my own (because I'm stuck in a bespoke framework on my main project) but it wrote me a plugin I needed for another app without any difficulty.

It's the first local LLM I've considered building hardware for.