Remix.run Logo
▲ GuB-42 5 hours ago

These formulations have been selected by reinforcement learning. People who aligned the LLMs chose this over alternatives.

You know when chatbots ask you which answer you prefer between two. People tend to chose the "as a langage model..." one, so it stuck.

▲leobg an hour ago | parent [-]

There are multiple levels:

1. Pretraining 2. Instruction / chat tuning 3. RLHF

The sentence did not exist in 1 (nobody on Reddit said this, and it was also never encountered in any libgen books). It was introduced in 2 and reinforced in 3. If you stick to the base models, you’re not gonna see it (first generation only, of course).