If you speak publicly at all as part of your job, it's actually a good thing to keep track of your verbal/physical tics and try to eliminate/minimize them. Whether it's "umm," "you know," a hand gesture you keep doing, subconsciously swaying back and forth slightly, or whatever. They're all distracting even before you get to the level where people start counting them.