People keep saying this but it's simply untrue. AI inference is profitable. Openai and Anthropic have 40-60% gross margins. If they stopped training and building out future capacity they would already be raking in cash.

They're losing money now because they're making massive bets on future capacity needs. If those bets are wrong, they're going to be in very big trouble when demand levels off lower than expected. But that's not the same as demand being zero.

▲

mbesto 2 hours ago | parent | next [-]

> Openai and Anthropic have 40-60% gross margins.

Stop this trope please. We (1) don't really know what their margins are and (2) because of the hard tie-in to GPU costs/maintenance we don't know (yet) what the useful life (and therefore associated OPEX) is of GPUs.

> If they stopped training and building out future capacity they would already be raking in cash.

That's like saying "if car companies stopped researching how to make their cars more efficient, safer, more reliable they'd be more profitable"

▲

adgjlsfhk1 8 hours ago | parent | prev [-]

those gross profit margins aren't that useful since training at fixed capacity is continually getting cheaper, so there's a treadmill effect where staying in business requires training new models constantly to not fall behind. If the big companies stop training models, they only have a year before someone else catches up with way less debt and puts them out of business.

▲

HDThoreaun 5 hours ago | parent [-]

Only if training new models leads to better models. If the newly trained models are just a bit cheaper but not better most users wont switch. Then the entrenched labs can stop training so much and focus on profitable inference

	▲	kuschku 5 hours ago \| parent [-]
		If they really have 40-60% gross margins, as training costs go down, the newly trained models could offer the same product at half the price.