Remix.run Logo
▲ GMoromisato a day ago

Probably right, but I think chain-of-thought has had a bigger impact on intelligence in LLMs. I.e., LLMs can reason their way to a solution instead of trying to one-shot it from training data.

▲stymaar 18 hours ago | parent [-]

I'd argue that it's the same thing. Asking a language model to “reason step by step” only marginally improved the results before we steered the thinking traces with RLVR.