To kill someone with a gun a person has to pull the trigger with the clear intent to kill.

The concern with AI, and the purpose of the OG paperclip maximizer thought experiment, is that the outcome could be extremely divergent from the intent of the original person pulling the trigger / sending the prompt.

Still more likely that a person types "kill all people" (or something tangential where this is the logical conclusion).

Right. And that's not accidental.