If you let fear dictate your life, you are correct.

He could have a discrete security detail nearby.

You should. And you do too. Otherwise, you would’ve never looked both ways before crossing the street, and you would already be dead.