This is so speculative. I think the first step in determining why some people believe they are much more competent than they really are would be to interview them on how they came to believe it.

I think the fact that the author thinks this is unnecessary and that he can determine the cause of this phenomenon without this sort of empirical research indicates he believes he is better at understanding how one goes about determining human psychology than he really is.