Remix.run Logo
▲ RAWGOD 2 hours ago

Well, if you accidentally leak the evaluation set into the training set, you can reach perplexity 0.

Or the training set might just grow to be so big, defining a truly independent evaluation set is almost impossible.