| ▲ | GMoromisato a day ago | |
Probably right, but I think chain-of-thought has had a bigger impact on intelligence in LLMs. I.e., LLMs can reason their way to a solution instead of trying to one-shot it from training data. | ||
| ▲ | stymaar 18 hours ago | parent [-] | |
I'd argue that it's the same thing. Asking a language model to “reason step by step” only marginally improved the results before we steered the thinking traces with RLVR. | ||