DeepSeek claims $38 of revenue per GPU, per hour for Flash V4. That is $332,880 per GPU, per year. This matches their DeepInfer numbers: 25,600 output tokens/s per GPU sold at $0.60 per million -> $55 minus some other overhead to arrive at $38.

For the bigger Anthropic and OpenAI models (and associated higher prices) there are many unknown factors. But presumably they also work hard on optimizations, and it's not so crazy to think they had or still have a lot of wiggle room to adjust prices.

▲

JacobAsmuth an hour ago | parent | next [-]

It's sad how far down you have to scroll to get the real answer. It's because Anthropic margins on inference are absolutely bonkers and it's easy for them to drop prices by 80% and STILL have positive free cash flow

▲

smallmancontrov 5 hours ago | parent | prev | next [-]

Yes, but DeepSeek went absolute goblin-mode on optimization and I would not be shocked to discover that OpenAI and Anthropic were behind on that front.

▲

Art9681 5 hours ago | parent | next [-]

OpenAI and Anthropic have more compute and the best frontier models to throw at the optimization problems. They have published articles on these efforts. For example, Dots, and Anthropic's upcoming "persistent agent" is because of these optimizations. Both companies often publish articles detailing a lot of their technical efforts. They just get buried among the flood of other news.

▲

332451b 4 hours ago | parent | prev | next [-]

Yes, I would not be shocked either.

Sonnet 5.5 is 16x more expensive at $10 per million output tokens. Kimi K3.1 is also $10 per million output tokens, and its number of active parameters is only 6.5x larger than V4.1 Flash (104B compared to 16B). These things are not directly comparable of course, but just to give an idea.

Even if inference of those models needs 16x, 32x, or 48x the number of GPUs compared to V4.1 Flash, still seems like potentially great revenue per GPU.

	▲	eeedda 2 hours ago \| parent [-]
		My friend you are looking at the wrong number. Its cash flows to the GPU that matter. Not revenue.

▲

4 hours ago | parent | prev | next [-]

[deleted]

▲

cactusplant7374 5 hours ago | parent | prev [-]

What is the TPS of DeepSeek? All of the LLMs I have tried are slow as molasses. \

	▲	selectodude 3 hours ago \| parent \| next [-]
		I pretty reliably get 200 tokens per second on deep infra.
	▲	micw 5 hours ago \| parent \| prev [-]
		I use TensorX (EU hosted) and get 330TPS

▲

ngl999 an hour ago | parent | prev | next [-]

Don't forget that Deepseek pays salary in RMB which is 1/7 of the value of USD.

▲

hattmall an hour ago | parent | prev | next [-]

Does Deepseek say how much those Clusters cost?

▲

eulgro 3 hours ago | parent | prev [-]

Given that they open sourced their inference framework, how realistic would be to buy hardware and become a provider on OpenRouter? These numbers are incredible.