now where do you get that pile to invest? I have a pile invested - but I'm close to retirement and it took me many years to save it up.

By working and investing. More successfully at some points than others. But you’re totally right that different people are better set up and more or less inclined to move on from a job than others.