>If you lived in these communities, unless you are neurodivergent, you would be doing the same thing.

As someone who grew up in one of these communities, this has not been my experience. Many, many people move away, and for varied reasons. What you're left with are people who stay in economically declining areas and want to blame everyone else for it. It's selection bias, and it is absolutely based on personal choice.