Remix.run Logo
foolswisdom 7 days ago

It's difficult to fix because the incentive is to make sure it has the answer, not to give it lots of questions to which there are known answers but have it answer "I don't know" (if you did that, you'd bias the model to be unable to answer those specific questions). Ergo, in inference, on questions not in the dataset, it's more inclined to make up an answer because it has very few "I don't know" samples in general.

DonHopkins 6 days ago | parent [-]

Maybe it was trained on the 1980's Nickelodeon show "You Can't Do That On Television".

https://www.youtube.com/watch?v=eWiG3LirUDk