I mean, it's most likely because you have an absolute shit load of numbers/contacts in your phone. In the old days people just had rolodexes filled with numbers and if that disappeared they were just as screwed.

I remember a few numbers of my most direct contacts and depend on backups for everything else.