Remix.run Logo
soiltype 6 days ago

That's all been thought of, yeah.

No, AGI isn't a good thing. We should expect it to go badly, because there are so many ways it could be catastrophic. Bad outcomes might even be the default without intervention. We have virtually no idea how to drive good outcomes of AGI.

AGI isn't being pursued because it will be good, it's being pursued because it is believed to be more-or-less inevitable, and everyone wants to be the one holding the reins for the best odds of survival and/or being crowned god-emperor (this is pretty obviously sam altman's angle for example)

diamond559 6 days ago | parent [-]

Is it believed to be inevitable, or are their careers just dependent on that being the case at all costs.

conartist6 6 days ago | parent | next [-]

Those seem the same to me

soiltype 5 days ago | parent | prev [-]

it is believed by some to be inevitable, yes.