And if the bubble does pop chaotically, the open weight inference providers will become even more viable as they'll be able to buy racks full of compute for pennies on the dollar.

Something very similar happened with the late 90s telecoms bubble, which collapsed a little before the dot com bust. There was a very nice living to be made by many small/mid-sized providers who were able to feed on the remains for about a decade afterwards.