Yes. Fundamentally goods and services at time you retire must be produced by someone. If there is less people producing that means that labour will get more expensive. Or then you must really kick down that population. And well if they don't take it well you might have no retirement...