Modern sshd limits the number of retries. I have 5 or 6 keys and end up DoSing myself sometimes.