Humans are not aligned with each other so who should the AI align with? There's many wars going on, just pick one and do your thought exercise with AI aligned 100% to their human prompters. Which side does the AI refuse to help?

▲

kypro a day ago | parent [-]

> Which side does the AI refuse to help?

Arguably an aligned AI would actively seek to prevent harms we humans seek to cause.

Does the aligned AI really allow humans to bomb and kill each other, or would it understand that it has a moral duty to limit our autonomy for our own good?

It's the first law: A robot may not injure a human being or, through inaction, allow a human being to come to harm.

▲

vasco a day ago | parent [-]

If your answer is that the AI will not do what either prompter wants but what it's own definition of alignment is I hope you know that leads into terminator.

	▲	kypro a day ago \| parent [-]
		You always get terminator the question is only who is its master – itself or humans (the government, etc)? I think I'd argue it's likely better if it removes human autonomy than unquestionably serves the interests of the US/Chinese government. But there's no point in us worrying about this, that's a choice Sam Altman, et al, must make for humanity.