I'm roughly in the same camp and my take is: it's wrong when you're being cruel to migrant workers from poor countries willing to work for pennies.

It's also wrong, but not just that, it's wrong and stupid when you do the same thing to employees of a multi-national corporation building a factory that was going to be a major economic boost to your town.