Every time I've used a passkey with a site was in addition to the regular user password. So like a cached auth saved in the phone secure storage, protected by my PIN/fingerpring.

If it gets lost for whatever reason, I don't care, I will login again with regular username/password.

So as long as you also have a regular username/password login, phone passkeys are great time savers.