It should be reserved for a human because humans have a body and a body can be put in prison.

A bit dramatic for effect but true.

Yes, this.

For a slightly less dramatic version - you can fire a human if they consistently do the wrong thing despite being told how to do it better.

Putting a big ball of matrix arithmetic on a Performance Improvement Plan makes no sense.

	▲	bee_rider an hour ago \| parent [-]
		I agree with this. I basically don’t feel comfortable trying to pretend a fancy matrix multiplication can be responsible for anything. But what if companies that don’t track responsibility outcompete those who do? In particular what if some perfect AI decision making ends up nailing decisions that maximize the expected reward for the company. And, well, if that comes at the cost of some unmanaged low-probability catastrophic risk, the company doesn’t care because all the decision makers are AI that don’t mind being shut off.