> When evaluating the Intelligence Index, it generated 150M tokens, which is very verbose in comparison to the median of 87M.

This is 100M fewer than Opus 5.5, 40M fewer than Fable 5.1, and about a third of Sonnet 5.5. In the top-6, it's 3rd, beaten by Muse Wonder at 140M and Astra at, impressively, just 60M.

▲

jwolfe 5 hours ago | parent [-]

That's versus Opus 5.5 max effort, no? Opus high has the closest cost and intelligence characteristics and generates far fewer output tokens per task than the one Kimi 3.1 Pro effort level we have data for.

▲

thepasch 5 hours ago | parent | next [-]

Yes, max effort is what the displayed-by-default score on the index is measured by. At xhigh, Opus 5.5 outputs 100M tokens, but remains only 1 point ahead of K3.1 rather than 5. And Sonnet at xhigh outputs 110M tokens and trails K3.1 by 3 points rather than leading by 3, at the same price point per mtok.

Opus 5.5 high trails K3.1 by 1 point, but outputs only 53M tokens, so it indeed comes out cheaper per-task. I think it's still remarkable that this is effectively an open model that matches the frontier for the first time in a long time, pretty much since DeepSeek R1.

	▲	Bolwin 2 hours ago \| parent [-]
		The original k3 also matched its respective opus

▲

TobTobXX 4 hours ago | parent | prev [-]

I think that this is Kimi K3.1 Pro on max too. Unfortunately, AA doesn't seem to test for other effort levels for models not from Anthropic/OpenAI.