General compute is also the worst solution to the problem.

Nvidia's entire business is dependent on Google not being able to make TPUs fast enough.

Google would have to start selling them (the real ones, complete with interconnect) to third parties. If google does that, though, Nvidia is done.

Unlike AMD, Google can actually ship software. AMD has never shipped good software other than drivers (maybe) in the entire history of the company, including both ATi's history and true AMD. They have always relied on Intel to provide the software.