They can't delete their accounts after the server hosting the account shuts down.

It's possible to contact the instances who retain the copies of the data, and have them delete it. It's not like the Fediverse is some kind of blockchain, where data is replicated forever unless authorised parties delete it. (And deletion requests can still be sent out by whoever controls the domain, after the instance is gone.)