Remix.run Logo
fastball 6 days ago

Mistral's best models are actually not open-source, and the ones that are open are not particularly competitive with other open-source models these days. Their highest ranked open model on LMArena[1] (mistral-small-2506) ranks below: Qwen3, various DeepSeek models, Kimi K2, GLM 4.5, Gemma, GPT OSS, etc.

All those things you listed as part of that story pretty much apply to any open model, so it's kinda a shite list if you want to be differentiated.

[1] https://lmarena.ai/leaderboard/text

kergonath 6 days ago | parent [-]

That’s true, but not very relevant. Mistral is not in the business of selling their free models. What they are doing for large companies is building datacenters and providing their proprietary models trained on proprietary and confidential internal knowledge and fine-tuned for specific tasks. No sane European organisation would let a Chinese company do this, and American ones are less and less appealing. There is a significant amount of money to be made there and they don’t need to hop on the AGI hype train. They "just" need to provide fast and competent specialised models.

fastball 6 days ago | parent [-]

It's very relevant if any other EU firm can take open models (regardless of provenance) and fine tune them in the same way. Mistral really needs to be producing at-or-near SOTA models for them to be differentiated at all, and they are not.

kergonath 5 days ago | parent [-]

Not even then. You need to compare the end products, which are not the open weight models.

I don’t care whether the LLM can have "PhD level thoughts" (lol) or is able to code golf like a Facebook engineer. It needs to be able to do its task (so all the infrastructure around the model matters just as much as the model itself) efficiently (so small models have an advantage). There are billions of weights in general-purpose models that are irrelevant for specialised uses.

The way to go is efficient models adapted to their task. It’s exactly the same thing as for industrial robots. Geeks get excited every now and then about humanoid robots, but in the real life we don’t need robots to stand on two legs or our LLM to cite Shakespeare.