| ▲ | chrsw 14 hours ago | |
You don't want to replicate the exact model, you want to build a system of similar capabilities. | ||
| ▲ | nl 12 hours ago | parent [-] | |
Great, but that seems a different concern to the auditability of a model. You can take the code for Kimi K3 now, take the training framework from Prime and the data from Olmo, spend some money on RL environments and some more money (!) on GPU training and end up with a system of similar capabilities. But that's completely different to being able to audit Kimi K3. Even if you had the exact code, data and training environments it is impossible to verify that the model you have came from that. | ||