Remix.run Logo
▲ ACCount39 2 hours ago

This graph specifically tries to measure pre-train perplexity. It measures the "foundation" of a given base model - before RL is applied to it.

On long term tasks, "CoT + RL" of o1/o3 beats GPT-4.5 resoundingly. But on raw base model perplexity, GPT-4.5 is a significantly better model than any of the o-series.

The curve following GPT-4.5 and o-series suggests that newer models take advantage of BOTH better base model capabilities (perplexity on held-out data) and better RL.

▲kalcode an hour ago | parent [-]

Ohh, neat thanks for the spotlighting that, I didn't know that.