Remix.run Logo
▲ origini an hour ago

I don't think there is perfect proof, but its taken as truth.

Indication for this are for example that Chinese models think they are another model: "chinese model think its claude".

My assumption is, that Chinese model found things Frontierlabs already had but didn't share. There was this paper were i had the feeling that this was a real and significant Research Result from Deepseek "DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression" but otherwise its just unclear.

The main issue is, that as long as it seems plausable that they do distillation, its hard to determine how big the gap is.

Not saying they can't catch up but they are also potentially limited by resources (money & nvidia GPUs)

▲rbehrends 31 minutes ago | parent [-]

> Indication for this are for example that Chinese models think they are another model: "chinese model think its claude".

There is evidence that some Chinese labs have been training on frontier model CoT (in particular from the analysis of reasoning traces [1]), but what models claim about their identity is pretty much worthless as evidence. LLMs are not self-aware. These claims come from whatever is in their training data, and Claude/GPT output including such statements is all over the public web, including in some huggingface data dumps. Consider that people got Opus claiming to be Qwen or DeepSeek when asked in Chinese, and you'll see how weak this particular evidence is.

[1] E.g. https://arxiv.org/abs/2608.09867