Huh, I just assumed everyone saw visual snow/noise in the dark, guess not. I was thinking of it like underexposed film grain.

I don't think I notice it that much with the night sky unless the stars are faint though.