The bad guys will steal that private key and decrypt the encrypted secrets the same way they can steal the unencrypted secrets directly.
If they are already in your server, what are you protecting then?