Remix.run Logo
▲ jacquesm 23 minutes ago

You can hill climb but you will (or at least, I think you will!) lose generality.

And no, that won't get you to AGI, that is a completely different goal.

▲banghua13 3 minutes ago | parent [-]

If you carefully curate the data, plus the original model isn't saturated for RL post-training, it's possible to improve targeted benchmarks without regression on other metrics. This experiment is done with terminal bench 4.1 as a target, and the regression on other benchmarks has been carefully controlled through data + infra design.