| ▲ | WithinReason a day ago | |
Interesting that they specifically nerf cyper-capabilities of open weight models: "In preliminary experiments on internal models, we found that without data removal at either the mid-training or the RL stage, downstream cyber capability would increase substantially. These findings gave us a concrete lever for control. For the open-weight release of K3.1 Pro, we identified and removed cyber-related data from both training stages, while retaining the general-purpose coding tasks needed for model usefulness." | ||
| ▲ | petu a day ago | parent [-] | |
Maybe it's intentional so government doesn't block open weight release. There was law proposal (rumour?) last week about Chinese labs having to get approved for weights release now. | ||