It looks to me like many of the psych diagnoses come down to how much trouble we have with the situation.

And, personally, I look at the world, do I meet the criteria for Asperger's? Probably, although without a time machine there doe not appear to be any way to be certain. But it's a so-what I have had no reason to ever talk to a psychiatrist about. A label won't change reality, it won't provide any solutions, why should I bother?