It would be interesting to benchmark a short training / inference run on the latest of TPU vs. NVIDIA GPU per cost basis