Are you trying to paint a conspiracy here? It seems like people just move around if they can, and one pressure that drives people away is a lack of housing even worse than other places' lack of housing. If there's less of a lack of housing (relative to how bad it is everywhere else), of course a place becomes more attractive to move to.