| ▲ | reasonableklout 2 hours ago | |
A common view is that RL is eliciting behaviors learned in pretraining [1], so even though many recent gains are achieved via posttraining, pretraining is still extremely important because base models provide all the latent potential. This is discussed a bit in the OP. [1]: https://www.interconnects.ai/p/elicitation-theory-of-post-tr... | ||