Then doesn't it make more sense for the people who prefer living among a high fertility rate to move to the places where there's a high fertility rate? Why should people who don't have that preference have to endure mass migration when they don't want, didn't ask, and didn't vote for it?

Makes no sense at all imo, especially when you consider the origin story and melting pot ethos that made the US what it was in the first place.