I've never gotten a straight answer as to whether AGI is a good thing for humanity or the economy.

Real AGI would be alive and would be capable of art and music and suffering and community, of course. So there would really be no more need for humans except to shovel the coal (or bodies of other humans) into the furnace that power the Truly Valuable members is society, the superintelligent AIs, which all other aspects of our society will be structured towards serving.

Real AGI might realistically decide to go to war with us if we've leaned anything from current LLMs and their penchant for blackmail

▲

UltraSane 6 days ago | parent | next [-]

Best case scenario for ASI is that they create enormous wealth and will keep humans around as pets because it costs essentially nothing, like in the Culture series by Ian Banks or The Polity series Neal Asher.

▲

autoexec 6 days ago | parent [-]

Humans are extremely costly in terms of the resources we need in order to survive, the space we take up, and the messes we make (everything from the shit and piss we generate to the wars/destruction/death/violence we inflict on pretty much everything around us). We'd make for entertaining pets, but we're the farthest thing from low maintenance. Even ignoring that all other animals on earth share many of the problems we'd impose on our owners we stand alone in having done devastating amounts of damage (some irreversible) to ourselves and our planet.

I'd hope that they'd keep a few of us around, but it's hard to see the logic in them keeping all of us and allowing us the freedom to live and breed the way we do right now.

	▲	UltraSane 6 days ago \| parent [-]
		"Humans are extremely costly in terms of the resources we need in order to survive" No. With the kind of wealth ASI can generate keeping 10 billion humans alive with a very good standard of living is like a human owning a cat.

▲

soiltype 6 days ago | parent | prev | next [-]

That's all been thought of, yeah.

No, AGI isn't a good thing. We should expect it to go badly, because there are so many ways it could be catastrophic. Bad outcomes might even be the default without intervention. We have virtually no idea how to drive good outcomes of AGI.

AGI isn't being pursued because it will be good, it's being pursued because it is believed to be more-or-less inevitable, and everyone wants to be the one holding the reins for the best odds of survival and/or being crowned god-emperor (this is pretty obviously sam altman's angle for example)

▲

diamond559 6 days ago | parent [-]

Is it believed to be inevitable, or are their careers just dependent on that being the case at all costs.

	▲	conartist6 6 days ago \| parent \| next [-]
		Those seem the same to me
	▲	soiltype 5 days ago \| parent \| prev [-]
		it is believed by some to be inevitable, yes.

▲

cindyllm 6 days ago | parent | prev [-]

[dead]