This is an absurd argument. Any one source is a drop in the bucket.

Any given optimization reduces running time of a program, but you should still focus on your hot loops.