Presumably they spend this much on frontier models. You don't run frontier models on GPU you "just buy".
You can run GLM 5.3 or Kimi K3 on maybe 40k in hardware these days.