| ▲ | zmmmmm 41 minutes ago | |
It seems like perplexity would also be a function of the composition of the training set. If the training set is high quality and therefore fundamentally more predictable, then a perplexity score would go down unless it accounted for that. | ||