Luna is meant to compete with Haiku. What tasks are you seeing it equal Opus on?

newtwilly 3 hours ago | parent | next [-]

According to the Artificial Analysis benchmark graph in the article, Luna can now outperform Sonnet 5 and Opus 5 low at ~4-10x less cost

▲

dannyw 2 hours ago | parent | prev | next [-]

You'd be surprised at what Luna can do, especially on xhigh or max. It's capable of working overnight, usually productively, just like Sol.

Haiku 4.5, on the other hand, is comparable to performance to Gemma4 31B (with working tool call formatting) in my experience, and Gemma4 strongly wins on vision and multimodal.

▲

euazOn 3 hours ago | parent | prev | next [-]

Per Artificial Analysis:

- Haiku: 30 points

- Luna Medium/High/Xhigh/Max: 38/46/49/51 points

That's a massive difference:

- 30 points is Gemma 4 31B territory

- 50 points is GLM-5.2 (744B) territory.

▲

tosh 3 hours ago | parent | prev [-]

luna is way better than haiku 4.5

	▲	nateb2022 3 hours ago \| parent [-]
		I use Luna a lot (over 1T tokens since it came out) and I'd rank Luna (high/xhigh) on par with Sonnet 5, without hesitation.