I feel like this quote needs a qualification. You can still fear what someone might say without fearing they are correct.

This is exactly what the quote is saying. You are adding on your own layer of bias by assuming he’s incorrect.