Remix.run Logo
▲ ben_w 15 hours ago

If your idea of doom is just the economy, I'm put in mind of:

  Sen. Richard Blumenthal (D-CT):
  I alluded in my opening remarks to the jobs issue, the economic effects on employment. I think you have said in fact, and I'm gonna quote, development of superhuman machine intelligence is probably the greatest threat to the continued existence of humanity. End quote. You may have had in mind the effect on, on jobs, which is really my biggest nightmare in the long term. Let me ask you what your biggest nightmare is, and whether you share that concern,
- https://www.techpolicy.press/transcript-senate-judiciary-sub...

Farming and real estate is not where doom risk comes from.

What percentage of the Bhopal economy was the Union Carbide plant? What percentage of Pripyat's economy was Chernobyl?

If all that happens with AI is it slowly displacing humans in economic roles, that's not by itself doom: although some bad outcomes exist there, it is also a prerequisite for UBI to be stable, which is about as un-doomy as I can get.

▲augment_me 10 hours ago | parent [-]

Neither of your examples ended humanity. Most people in rural Brazil without any kind of digitalization or connection never had to care or were affected by Chernobyl.

The same way, even if AI somehow hacks everything if it poisons large cities somehow with a biochemical attack, those people will go on living their lives as before and humanity will be fine.

▲ben_w 9 hours ago | parent [-]

> Neither of your examples ended humanity

Obviously.

They're not meant to show that.

The sole point is to show that severity of damage is not limited to the percentage of the economy of that sector.

If you can only change your mind about the potential for risk after everyone is dead, I'd say that's "leaving it too late".

> The same way, even if AI somehow hacks everything if it poisons large cities somehow with a biochemical attack, those people will go on living their lives as before and humanity will be fine.

And what if the AI is simply used to support (e.g. it's bought to run PR campaigns) the fossil fuel industry to the point of us buring all the reserves? Simply used to support the beef farmers who want to clear-cut rainforest for ranches?

Those two things combined, alone from support of any other industry, is enough to mess up not only the climate, not only global biodiversity, but is enough to imperil (but not necessarily destroy) human civilization.

Beef and fossil fuels are a tiny percentage of the global economy, perhaps 2% combined. There's a lot of room in the other 98% for outsized dangers to turn "imperil" into species-wide hoist by our own petard.