Well the better your beam is directed, the less lateral noise there is.

A simple 3 element yagi has <1% of the power to the sides. It has more of the power straight behind it, but still 1% or so of the main lobe.

Is 1% still quite a lot louder than other things in the same band?