> the whole point of secrets is that at least two parties know

This isn't true. If I do something privately by myself and never tell anyone it's still a secret. If I have a hidden compartment in my desk to hide things and I'm the only one who knows about it, it's a "secret compartment". A secret doesn't have to involve a second party at all.

And in fact, we have a dedicated term for shared secrets