Remix.run Logo
drdeca 2 days ago

For some senses of “wanting things”, I think it might be hard to make a powerful AI that couldn’t be easily modified to produce one that “wants things” in some sense.

So, if it would be bad thing for one to be made that “wants things” in any reasonable sense of the phrase, then it would probably be bad for J Random to be able to take a copy of a powerful AI and modify it in some way, because someone is likely to try doing that.

Of course, perhaps the best way to make sure that J Random doesn’t have the ability to do that, is to make sure no one does.