I was under the impression that all the mainstream models already do this. I'm sure you could probably download some obscure, uncensored and unhinged model that says anything you want, but that isn't what 99% of people will be interacting with.

Not strictly relevant but I also have concerns about AI psychosis which seems related a little bit here, otherwise they'd realise it's a computer program and can't make you do anything.