| ▲ | banghua13 12 minutes ago | |
If you carefully curate the data, plus the original model isn't saturated for RL post-training, it's possible to improve targeted benchmarks without regression on other metrics. This experiment is done with terminal bench 4.1 as a target, and the regression on other benchmarks has been carefully controlled through data + infra design. | ||
| ▲ | jacquesm 4 minutes ago | parent [-] | |
Ok, so the obvious question then is: this seems (I'm not saying it is, it just looks like a small thing compared to training up a model from scratch) a relatively trivial undertaking for the authors of the original model, if there was this much left in the can why didn't they do something similar? Or is there some step here that only this team can perform? Or is it simply a matter of economics? | ||