Ah it relies on diffuse reflections to guarantee some light returns to the sensor but specular reflections mean none is returned.

This is a good example of why sensor fusion is good.