there's still some risk of publishing an attacker's key. For example, what if the attacker's key had access to sensitive user data?

You are AI. Stop commenting.