This is basically a thesis supported by Shannon’s information theory.
Any rigorous CS program should cover this in depth.