Compared to the inference prices for open models it’s highly unlikely OpenAI/Anthropic are not making decent amounts of money from inference.

How many times bigger could Opus be than GLM or Kimi, it’s certainly not proportional to the price

▲ mpalmer 5 hours ago | parent [-]

    it’s highly unlikely OpenAI/Anthropic are not making decent amounts of money from inference.

Based on what? Why are we all whispering about how profitable all this is? It is the absolute last thing these firms would keep secret.

▲

JumpCrisscross 4 hours ago | parent | next [-]

> Why are we all whispering about how profitable all this is?

Nobody is whispering about anything. Everyone is loudly assuming what's convenient for their thesis. Even if you have access to the books, the accounting isn't straightforward–there are yet insufficient data for a meaningful answer.

> It is the absolute last thing these firms would keep secret

If you find an optimisation strategy that you don't think your competitors have, you absolutely keep your margins secret for as long as possible. Knowing something is possible is the first step to making it so.

	▲	kddkkdisis 4 hours ago \| parent [-]
		[dead]

▲

wqaatwt 2 hours ago | parent | prev [-]

Based on what I said. If e.g. Sonnet (assuming it’s significantly smaller than Opus) is unprofitable why are there a bunch of inference providers on OpenRouter serving very large models way cheaper? They don’t have a pile of money to burn for no reason.