Since the Chinese companies publish their research it would have been odd if Mistral didn't start catching up.

It certainly has helped OpenAI and Anthropic get their KV cache costs under control.

Tade0 7 hours ago | parent | prev | next [-]

It's no secret that everyone is dis-stealing from everyone else.

	▲	drbscl 6 hours ago \| parent [-]
		I don't see how distillation relates to using the published techniques developed by Deepseek, Moonshot, Zhipu, etc

touche