The biggest obstacle is that planetary extraction has to become too expensive, so space extraction becomes viable. If that were the case, it would probably be safer to mine the Moon, to avoid further messing of the atmosphere with refineries or even more frequent space flights.