Remix.run Logo
wkcheng 11 hours ago

If the benchmarks are real and reflect actual use, then this is an insane model. This 300B model outperforms the previous DS4 Pro preview model (1.8T params), and it looks like it outperforms GPT 5.6 Luna too. And it's still cheaper than Luna, even with the price decrease.

Crazy.

gr_norm an hour ago | parent | next [-]

OpenAI must've known this was coming, hence the Luna price drop. This competition is amazing!

cbg0 9 hours ago | parent | prev [-]

On DeepSWE Deepseek is 54.4% and Luna is 67%

benjiro29 8 hours ago | parent [-]

But on Terminal bench, its

* DS4 Flash: 82.7

* GPT 5.6 Luna: 75.7

For reference, that puts it on the third spot behind GPT 5.5 and Fable 5. For some reason GPT 5.6 Sol is not showing in the leaderboard. If it did, then DS4 Flash was number four.

The thing is, even if Luna is better in DeepSWE and has the 80% discount. DeepSeek is still cheaper.

--------------

DeepSeek V4 | Flash GPT-5.6 Luna (New)

--------------

Input (Cache Hit) $0.0028 $0.02

Input (Cache Miss) $0.14 $0.20

Output $0.28 $1.20

--------------

Both Luna and Flash are heavy on the reasoning > output. And the cache hitrate + prices also matter.

Reality is, you can not go wrong with Luna or Flash at those prices. And remember, DeepSeek V4 Pro is still in the rafters, what is ironically closer to Luna's new price.

flashblaze 6 hours ago | parent [-]

Agreed. The only thing missing is multimodal capability