Do the people who sign sworn affidavits already have to have proven identities? If so, then they're unable to recover from a situation where they lost everyone's identity.

In Austria, there is the concept of "Amtsbekanntheit", meaning if the government officer knows you, that's also valid proof of identity.

You start with the queen. Everyone knows who she is.