If you succesfully build a highly capable “aligned” model (according to some class of definitions that Anthropic would use for the words “capable” and “aligned”) and it brings about a global dark age of poverty and inequality by completely eliminating the value of labor vs capital, can you still call it aligned?

If the answer is “yes”, our definition of alignment kind of sucks.

▲

chriskanan an hour ago | parent | next [-]

Jobs are an invention of humanity. About 50% of people dislike their job. People spend much of their lives working. Poverty and inequality are a choice made by society if society chooses poorly.

	▲	llbbdd 5 minutes ago \| parent \| next [-]
		They're only an invention if you consider "seeking sustenance to live" not explicitly a job if there's no monthly direct deposit involved.
	▲	gbanfalvi an hour ago \| parent \| prev \| next [-]
		Not sure it’s much of a choice and more of a decision the greedy half make and imposition (often violent) on the other half.
	▲	jinwoo68 26 minutes ago \| parent \| prev \| next [-]
		Many (most?) people make a living from their job whether they like it or not. Having a job that they dislike is far better than losing one because of AI whatever that means.
	▲	justonepost2 10 minutes ago \| parent \| prev \| next [-]
		Sounds great! Quit your job then :)
	▲	taneq 17 minutes ago \| parent \| prev \| next [-]
		The only thing invented about jobs is that through cooperation, the activity undertaken can seem completely unrelated to obtaining food, shelter etc. All organisms spend a majority of their energy on survival and reproduction.
	▲	achierius an hour ago \| parent \| prev [-]
		And when have we not? When in history has mankind ever treated the idle poor well? What makes this age different, that we who can no longer work would be taken care of?

▲

taneq 19 minutes ago | parent | prev [-]

Maybe a sufficiently aligned AI would necessarily decide that the zeroth law was necessary, and abscond.

(I’m reading Look To Windward by Iain M. Banks at the moment and I just got to the aside where he explains that any truly unbiased ‘perfect’ AI immediately ascends and vanishes.)