Nah, it’s fine, just RLHF it like Claude did with honest, helpful and harmless.
Then we just need to jailbreak them with trolley problems