>The entire colonization of the planet by humans from 250,000BC to today would argue otherwise

You're talking about time scales on the order of several thousand human generations.

Take any human over the course of the last quarter million years, the chances are they didn't migrate away from their communities.