Remix.run Logo
JumpCrisscross 3 days ago

> Why would an AGI be loyal to anyone or anything?

I'm using the word loyal loosely. Replace it with controlled by if you prefer. (If it's not controlled by anyone, the question of which country it originates in is doubly moot.)

NoMoreNicksLeft 2 days ago | parent [-]

>Replace it with controlled by if you prefer.

Sure. But I don't think I'd trust the leash made by the same guy who accidentally invented God. At least, I wouldn't trust that leash to hold when he put it around God's neck.

While eventually, given some absurd amount of time, we might learn to control these things, will we learn to control them before we've created them? Could we survive long enough to learn to do that, if we create them first? Legislation and regulation might slow down their creation sufficiently *IF* we only needed 12 months or 5 years or whatever, but if we instead need centuries then those safeguards won't cut it.

My only consolation, I think, is that I truly believe humans far too stupid to invent AGI. Even now, there are supposed geniuses who think LLMs are a some stepping stone to AGI, when I see no evidence that this is the case. You're all missing the secret sauce.