Remix.run Logo
▲ reasonableklout 2 hours ago

A common view is that RL is eliciting behaviors learned in pretraining [1], so even though many recent gains are achieved via posttraining, pretraining is still extremely important because base models provide all the latent potential. This is discussed a bit in the OP.

[1]: https://www.interconnects.ai/p/elicitation-theory-of-post-tr...