Remix.run Logo
pyrale 3 hours ago

> tremendous amounts of inference capacity become open for pennies on the dollar.

They can't be operated for pennies on the dollar, though. The likely current status is that these products are subsidized to disregard model cost, and part of the operating cost.

If the bubble bursts, inference that can't be made profitable when factoring in operating costs will be scraped, not sold for pennies.

SpicyLemonZest 3 hours ago | parent [-]

I don't necessarily agree that's likely, but is it even the case that Mistral is more expensive than GPT or Claude? My understanding is that it's cheaper, which means it would fare worse in the scenario you're describing, unless they've perfectly calibrated the quality-cost tradeoff better than any American company.

pyrale 3 hours ago | parent [-]

All they have to do to survive is have enough cash flow to pay for their operating costs.

By providing specialized long-term services to corporate clients, they are securing exactly that.