>Kind of like how xAI started hosting anthropic workloads with colossus cluster.

Google has been hosting part of Anthropic's load long before that deal. They had a big degradation due to compiler bug for TPUs in an optimization they made to work around TPUs not being able sample from the logits efficiently.