They do different things and sit in different parts of the stack (training vs inference). TorchTPU seems more like a play to get more people familiar with Googles TPU chips as they want to sell them to people outside of google.

Yeah I'd assume this is to allow us to train on their TPUs with torch instead of needing to rent a GPU