Even doodling on the margin can be distracting. Or doing little tricks with the pencil. But these don't distract the verbal part of the brain as much perhaps.