The point is not that it is something hard to compute that we can only approximate. The point is that there is no well-defined heritability independent of the environmental distribution.

There's no well defined "a rock too heavy for a person to lift" too, but we manage. So, what's the point?