People live on mountains just fine.

This exact same problem exists on mountains, which is why there are no permanent settlements above 5,100m. The Apollo pressure mentioned above (1/3rd atm) is roughly equivalent to an elevation of 8,500m, well into the "death zone" for a normal atmospheric mix.