>Will the agent stab a baby?

>Well you see that's a nuanced question depending on the context and moralistic frameworks as we don't want to impose on the models.

It's as dangerous to think it can have morals as thinking a lawn mower can have morals.

Will a microwave microwave a baby if you ask it? Yes.

"Teaching it" is not a road to safety.