> Physics really works out such that the smaller you make camera sensor, the smaller you can make the lens.

At some point the wave-like nature of light starts to bite. Can't really go much smaller than a micron per pixel. So a millimeter sized chip gets you 1 megapixel. 50MP mean ~7mm. (back of the envelope caveats apply)