Remix.run Logo
andai 4 hours ago

I'm finding Luna suprisingly adequate for my work. I slept on it due to the benchmarks, but it's very fast and even on low reasoning I'm finding it more than adequate for "menial" work. (The speed is crucial for "interactive" work -- if a model is fast enough it goes from "async" to "real time", subjectively, which is a huge difference.)

In fact, I'd say it's overqualified for the kind of work I'm doing, because it spends >half the time verifying trivial changes (and the verification isn't as helpful as you'd expect, even with bigger models).

Maybe I can prompt it to be less aggressive about that (the new GPT models do it even without prompting).

Anyway, Ultrafast Luna would be amazing, though I strongly doubt they can offer Cerebras at anything approaching the current prices. Now we wait for Moore's Law? :)

shepherdjerred 2 hours ago | parent | next [-]

Luna is incredible considering the cost. It’s very good for routine work.

phoghed 2 hours ago | parent | prev | next [-]

Luna has impressive results on DeepSWE.

I mostly split work between Luna and Sol. If something seems simple enough I always try it with Luna first.

epolanski 3 hours ago | parent | prev [-]

I feel odd to use these models, because it feels like a faster model doesn't feel that much faster if it spends reading files, making edits and running checks.

It feels too situational.