Wow, crushing 2.5 Flash on every benchmark is huge. Time to move all of my LLM workloads to a local GPU rig.

embedding-shape 3 days ago | parent | next [-]

Just remember to benchmark it yourself first with you private task collection, so you can actually measure them against each other. Pretty much any public benchmark is unreliable at this moment, and making model choices based on other's benchmarks is bound to leave you disappointed.

	▲	MaxikCZ 3 days ago \| parent [-]
		This. Last benchmarks of DSv3.2spe hinted at beating basically everything, yet in my testing even sonnet is miles ahead both in terms of speed and accuracy

▲

red2awn 3 days ago | parent | prev | next [-]

Why would you use an Omni model for text only workload... There is Qwen3-30B-A3B.

▲

skrunch 2 days ago | parent | prev [-]

Except the image benchmarks are compared against 2.0, which seems suspicious that they would casually drop to an older model for those.