If I wire my autocomplete to launch nukes, there are definitely reasons to worry.

It's not just an ethical problem.

I'd trust Claude more with nuclear codes than the current US commander in chief