| ▲ | ACCount39 2 hours ago | |
This graph specifically tries to measure pre-train perplexity. It measures the "foundation" of a given base model - before RL is applied to it. On long term tasks, "CoT + RL" of o1/o3 beats GPT-4.5 resoundingly. But on raw base model perplexity, GPT-4.5 is a significantly better model than any of the o-series. The curve following GPT-4.5 and o-series suggests that newer models take advantage of BOTH better base model capabilities (perplexity on held-out data) and better RL. | ||
| ▲ | kalcode an hour ago | parent [-] | |
Ohh, neat thanks for the spotlighting that, I didn't know that. | ||