I don't have your use-case, but I use the `.ssh/config` to give aliases (Host/Hostname) to my remote machines and can set the identity to use there (IdentityFile).