https://cloud.google.com/tpu/docs/system-architecture-tpu-vm

should have most of it