Remix.run Logo
▲ StableAlkyne 13 hours ago

> What stops another power from developing its own AGI a year or two later?

Well, the fact that we're all gone before then if we're unlucky. If we're on a lucky enough timeline where AGI with RSI doesn't immediately end civilization, then maybe we last long enough for the second to be created at least.

But unless we solve the AI assignment problem, it really doesn't matter if we quickly get 2-3 AGIs: an unaligned AI will be the end of us in the long term.

One would hope that self preservation would be a factor, but it seems hubris has deluded many people into thinking they can control a superhuman intelligence.