Are you talking about SSH or a different setting?

With SSH, you can always share the primary and backup pub keys, even if you don't have the backup key handy.

No I got distracted by the word yubikey. Arguably not the same subject. :)