The vision system has evolved to consider as white the average color of the environment.

In terrestrial environments, the average color is typically not much different from the true color of the Sun. The white light of the Sun is split by the atmosphere into the bluish light of the sky and the yellowish direct light, then those are reflected and diffused by various bodies until being collected by an eye or a photographic camera.

If the bodies in the environment are random enough, i.e. there are similar amounts of those which absorb or diffuse different parts of the spectrum (e.g. the environment includes brown earth, green plants, blue sky, variously colored flowers and fruits, etc.), then the average color of the light that reaches the photoreceptors will not differ much from the color of the original source of light, i.e. the Sun as seen from outside the atmosphere.