I think we'd start to hit problems before the population got to infinity. Half infinity or even half of half of infinity would be a real issue.

I'm no mathematician but isn't half of infinity still infinity? (or is that the joke?)