Remix.run Logo
▲ bscphil an hour ago

If I had to guess, RL increases perplexity, but the metric is being evaluated on only their base (pre-trained) models. Highly efficient text prediction in the base model still correlates strongly with model intelligence, because there's nothing else the model could realistically learn during pre-training. Perplexity thus tracks the evolution of model intelligence over time very closely, even though (maybe) it isn't the largest component of intelligence at the end of the day.