Whilst those other layers are useful, none of them are particularly hard to build or rebuild when you have many millions of dollars on hand.

One doesn't need tens of billions for them.

Yeah, because making good chips (TPU) and compilers (XLA) is notoriously easy, right?