In practice we know that LLMs have aided in suicide, so what they should do in theory doesn't matter.

And how many people can it be credited for saving from self harm? Probably countless more than it has harmed, if I had to bet.