| ▲ | ACCount39 2 hours ago | |
Interesting that GPT-4.5 is the only discontinuity on the graph. The oversized monster LLM has performed worse than CoT-trained o1 and o3 on the benchmarks, so CoT + RL clearly provided better "real world performance" improvements - let alone "price/performance." But if pre-training perplexity on held-out data really does measure something like "base model IQ" or "base model g factor", then it does support the hypothesis that 4.5 still had more "intellectual potential" than the o-series. So, if you were wondering why do AI companies train 10T+ monsters now, and are taking aim at 100T too? It's because scale works. | ||