Remix.run Logo
bayarearefugee a day ago

> it may underestimate the inference margins of Ant/OAI's API pricing.

If true then why are neither Anthropic or OpenAI dropping their API pricing to gain market share when both are clearly doing all sorts of political and PR maneuvering to compete in a cutthroat market?

Since they aren't dropping the API usage prices (and are in fact raising them in a lot of subtle ways) then one of these options almost has to be true: they are still subsidizing inference, training costs are so ridiculously high that they need to make huge profits off inference or collapse in on themselves, or they are price fixing.

CuriouslyC a day ago | parent | next [-]

The training costs are very likely the reason. Dario has talked about how each individual model is profitable, but how the expenditure training the next generation of models makes it look like they're not profitable at any given moment in time, and I believe he's being honest about that.

The market for open weight model hosting gives you an idea of the profitable price floor, it's pretty clear there's markup baked into OAI/Anthropic's APIs.

player1234 4 hours ago | parent [-]

[dead]

simonw a day ago | parent | prev | next [-]

> If true then why are neither Anthropic or OpenAI dropping their API pricing to gain market share

Maybe because they're trying to IPO this year, and their IPO prospects will be a lot worse if their S-1s show them to be losing money on inference as opposed to making a healthy profit.

orangecat a day ago | parent | prev | next [-]

If true then why are neither Anthropic or OpenAI dropping their API pricing

They are? In the before times of 2025, Opus 4.1 was $75 per million tokens. Opus 4.8 is $25, and Fable is/was $50.

827a a day ago | parent | prev | next [-]

Company-wide their margins are trash (probably negative). They need as much inference margin as they can get to afford the massive training runs. It is likely that we'll see GPT-5.6 reduce API pricing to compete against Anthropic, but whether Anthropic feels they need to reduce their prices is anyone's guess.

wqaatwt a day ago | parent | prev | next [-]

Why would they? If they see the market as a duopoly for now and don’t consider open Chinese models a fully credible threat that might start eating into their share then they have the incentive to charge as much as the market can bear instead of under cutting each other in a pointless price war.

matheusmoreira a day ago | parent | prev [-]

Nobody cares about their training costs. Their collapse is the optimal outcome for humanity. Oligarchs blowing trillions on a godlike AI, only for the model to leak so that everyone with the hardware can use it, is literally the best case scenario.

brokenmachine 15 hours ago | parent [-]

How large is a model, like Mythos for example? Multiple Tb?

If that happened, what would people need to run it?