Remix.run Logo
▲ robotresearcher 2 hours ago

If the task is to predict what a human would say, then a perfect oracle would produce what a human would say, even if it was factually incorrect.

▲plasticchris an hour ago | parent [-]

But if the task is to be correct and useful in the maximum likelihood then this is unlikely to be the metric used