| ▲ | bredren a day ago | ||||||||||||||||
If the distillation "attacks" created useful inputs to open weight models, ai-2027 was directionally correct that the Chinese would find ways to extract IP from western firms. (Scaled account creation and grinding outputs etc is not a dramatic story element as spies, though!) Whether the distillation has constituted "attacks" or has or will meet the bar of "stealing" IP is not super interesting to me, though. | |||||||||||||||||
| ▲ | vlyan a day ago | parent | next [-] | ||||||||||||||||
the chutzpah of calling it an `attack` or `stealing` is super interesting tho. | |||||||||||||||||
| |||||||||||||||||
| ▲ | haaz 20 hours ago | parent | prev [-] | ||||||||||||||||
The idea that distillation is a significant contributor to the capabilities of the Chinese models is not true. Kimi K3 came out 2 weeks after Fable and uses a number of novel NN architecture innovations. | |||||||||||||||||
| |||||||||||||||||