> This was probably fine 4000 years ago, when the world was looser, and people could find their place in life regardless of their particular quirks, but not so much nowadays.

Is this likely? My overgeneralizing gut feel would be that more people who would have traits which might be perceived as unusual and impede survivability 4000 years ago would be more likely to receive a chance to live a regular lifespan in most today‘s societies.