Isn't that the difference between a threat of violence as opposed to violence? Which is directly adjacent and thus treated similarly by the law.

Brandishing a gun at someone is a threat that you'll shoot them but, importantly, is not the same thing as actually making good on the threat. (From the victim's perspective the distinction is rather important.)