Not to contradict your point, but in 2011 RSA's SecurID backend servers were hacked. TOTPs require shared secrets, and their server had all the secrets to the SecurID keyfobs they managed. Security is hard.