iirc isn't the whole point of crypto that no one knows what you have or what you do with it?

They know even less with cash!

Crypto is not as reliably anonymous as cash. Anything with a distributed ledger is pseudonymous so if one transaction can on your wallet can be linked to you, so can all other transactions, including historical ones, to that wallet.