Remix.run Logo
▲ mirekrusin an hour ago

Open-weight models

Kimi K3.1 Pro: −9

DeepSeek V4.1 Flash 1017: −13

GLM-5.3: −13

MiMo-V2.6-Pro: −16

Proprietary models

GPT-6 Astra: +4

GPT-6.1 Sol: +3

GPT-6.1 Terra: +3

Claude Opus 5.5: 0

Claude Sonnet 5.5: −2

Claude Fable 5.1: −3

Gemini 4 Argon (high): −3

Muse Wonder Full: −6

Claude Haiku 5.5: −7

Muse Wonder: −9

Gemini 3.8 Flash (high): −10

Grok 4.7 (high): −11

Is there affiliation with OpenAI or coincidence?

▲susiamongi an hour ago | parent [-]

Yeah, this smells. Ain't no way Terra went up and Deepseek so far low. I have had the later beat the former on multiple criteria by simply being less distracted.

There was a thread here about families of models responding in the same patterns to specific queries like "say a random word", and it takes less than two minutes to verify it is true. It'll take a bit of effort to not convince me this change wasn't reverse-benchmaxxed to screw everyone other than OpenAI. I'll be less distrustful after everyone is done IPO-ing.

▲moostii an hour ago | parent [-]

My experience is not consistent with yours.