GPG keys are typically guarded much better than emails, that's the whole point. Accessing e-mails can be done by guessing a password, to get to the key you basically need command execution on the target's client system.