I've seen sources like this before. It's all hearsay and promo. I was asking for any publicly available verifiable information regarding the cost of inference at scale. I haven't seen any such info personally which is why I asked.

I'm dying to see S-1 filing for Anthropic or OpenAI. I don't actually think inference is as cheap as people say if you consider the total cost (hardware, energy, capex, etc)

▲

KaoruAoiShiho 3 hours ago | parent [-]

Well they're not public yet so you'll have to put up with rumors. But the numbers are available for companies like DeepSeek say they have an 80% profit margin, so it stands to reason OAI etc would do similar numbers considering they charge much more.

▲

caminante an hour ago | parent [-]

AFAIK,

1. the 80% margin from 2025 was theoretical,

2. they're relying on distillation/synthetic data for training,

3. and have been very opaque about cross-subsidization of R&D with their models.

The distillation alone adds a big asterisk for comparisons.

	▲	KaoruAoiShiho 24 minutes ago \| parent [-]
		Talking nonsense.