We know labs make money on inference, and we know they lose a lot of money on inference+training.

lelanthran 3 hours ago | parent | next [-]

> We know labs make money on inference

We don't really know that, for OpenAI and Anthropic. We suspect that, but as far as I know, even they have stopped claiming that they are profitable on inference.

	▲	anthonypasq an hour ago \| parent [-]
		unless you think that Opus is 10T+ params, its pretty much impossible for inference not to be profitable when doing some basic napkin math on other open models, and if Kimi K3 is 3T params with the same performance as Opus then that means that China is actually way more technologically advanced than the American labs. So which is it?

▲

vb-8448 3 hours ago | parent | prev [-]

Just out of curiosity, based on what we know for sure they(OAI+A) make money on pure inference and lose on inference+training?

	▲	nl 3 hours ago \| parent [-]
		OpenAI's financials leaked and showed this pretty convincingly. Anthropic was probably profitable last quarter, without training costs: https://www.wsj.com/tech/ai/mind-blowing-growth-is-about-to-...