Your working conditions and salary would be substantially higher if those people weren’t in the country to begin with.

To my knowledge economists do not believe this one is black-and-white, but that's much more of a question about the issuance of H1B visas they begin with anyway.