> If we all had the exact same bias then it would be a huge problem.

And may I introduce you to "groupthink" :))

Now imagine that every opinion you have is automatically fully groupthinked and you see the difference/problem with training up a big AI model that has a hundred million users.

The problem does exist when using individual humans but in a much smaller form.