Apparently Google and team will build ASICs to run Gemini even though they have TPUs and it’ll be somewhat dynamic since the weights can be made modular [1]

[1] https://finance.yahoo.com/technology/ai/articles/google-plan...