The issue here is that nowhere is the wellbeing of the low income natives considered.

Is it not considered, or do they just disagree on the effects? The open borders advocacy I've seen is based on it being good for everyone.