Remix.run Logo
▲ zmmmmm 41 minutes ago

It seems like perplexity would also be a function of the composition of the training set. If the training set is high quality and therefore fundamentally more predictable, then a perplexity score would go down unless it accounted for that.