But how will we ensure human CEOs are properly aligned? We can't fine tune them, inspect their internals, or repeatedly assess their behavior in isolated containers.

...can we?

You'd need quite large containers. I should think at least a metre cube, unless you can test just the head in isolation. Which would also be a guard against container escape.