You should only be comparing the working age population or maybe even the ratio between that and retirees since absolute population is a deceitful metric.