If they make it really right, then eventually the annoying people will come too and we are back to square one.
Not if you ban them, which is the missing ingredient.
I am afraid you might have seriously underestimated the number of annoying people around you.