| ▲ | theptip 2 hours ago | |
This is definitely a conjecture; it gets to how much SGD will generalize out of the training distribution. If pretraining alone was sufficient then nobody would do RL. And, heavy RLVR on coding/math is why these models are savant-level in those domains, yet not superhuman at all fuzzy reasoning and practical wisdom tasks that are only represented in the pretraining corpus, and don’t have an RL target. | ||