Remix.run Logo
solenoid0937 a day ago

I hope everyone recognized the cheap tokens as a transparent ploy to gain more users before jacking up prices. This was obvious from day one.

skybrian a day ago | parent | next [-]

Your cheap cynicism makes OpenAI's lower prices sound like a reason to avoid using them, but that's backwards! It's a better strategy to use them now while prices are low and switch later if necessary. Nobody knows who will have the best prices later, so better to decide later.

cj a day ago | parent | next [-]

It’s good to be aware when you’re buying something that’s subsidized. No need to downplay the importance of awareness.

skybrian a day ago | parent | next [-]

Aware of what, though? We don't actually know OpenAI's profit margins on inference. Do we need to know?

It's enough to know that the market is competitive and new models with better prices are released often. This means you should have a way to switch models.

cj a day ago | parent | next [-]

The entire market is subsided more than it is competitive. The market wouldn’t exist the same as it does today if it weren’t being propped up. Thats the point.

I remember the days when I had a $2000+ credit balance on Uber because I mastered their referral program. “Free” uber blacks for 2 years!

When you’re using free shit that you should probably be paying more for, it’s good to not fool yourself.

In the Uber example, the fact that Lyft also existed at the time didn’t matter to me as someone happily riding around the city in Uber Black for $0. Unfortunately Lyft’s referral program wasn’t so lucrative so I couldn’t switch…

fgkramer a day ago | parent | next [-]

How does this work with inference providers behind OpenRouter? Are you saying that all of them are actually losing money?

cj a day ago | parent | next [-]

> Are you saying that all of them are actually losing money?

Are you saying these companies are operating on anything resembling a sustainable business model?

I think not!

If OpenAI needs to impose 5 hour limits during a time where they are aggressively trying to grow market share, what do you think they (or whatever the winning provider is) will do in 5 years once they IPO and need to boost margins?

They won’t be as friendly with usage caps as they’re being now.

thejazzman 20 hours ago | parent | next [-]

`needs to impose 5 hour limits ` I'm no OpenAI defender but that's like saying Apple is going bankrupt because they charge for their products. Why wouldn't they do everything they can to turn $20 users into $200 users?

solenoid0937 12 hours ago | parent | prev [-]

Exactly. It is common knowledge that all the AI companies have terrible margins. IMO tokens are the cheapest they'll ever be as these companies compete for users.

qlte a day ago | parent | prev | next [-]

To the extent that the 3rd party inference resellers are a viable market because of Chinese/certain US AI labs (current) willingness to absorb substantial compute/R&D/data harvesting costs while releasing weights on permissive licensing terms for free, then yes, current pricing is distorted.

stymaar a day ago | parent | prev [-]

Where can I sign up for a monthly subscription on OpenRouter instead of paying the real API price?

cuttothechase 21 hours ago | parent [-]

Openrouter is not so open as well, right? They take the middle man cut by enforcing their own limit restrictions and 429s on top of the model provided limit restrictions and what not.

Now why would I pay a middle man anything if I can get the same hosted model without their own whimsical service limits?

skybrian 19 hours ago | parent | prev [-]

Uber isn't a good comparison. LLMs are a national or global market, not a local one. Also: already driverless.

MikhailTal a day ago | parent | prev | next [-]

Aware that this is essentially a soon to be deprecated service. As any vendor you need to know the life expectancy of it, plus forecast/predict any pricing changes. You really do not want to become dependent. Even if competitors exist, there still some non trivial cost to switch

skybrian 19 hours ago | parent [-]

My cost to switch is choosing a different model from a pulldown menu.

solenoid0937 a day ago | parent | prev [-]

Aware that the rug will be pulled. The market runs at a loss

rgbrgb a day ago | parent | prev [-]

agree and underscores the idea that you should keep your setups portable between model providers by using external memory systems and connector gateways

NewJazz a day ago | parent | prev [-]

Only if switching costs are low. If you are investing in the platform and integrating deeply, then planning to switch may not be a good plan.

fny a day ago | parent | prev | next [-]

I hope everyone recognizes they aim to make you dependent on their intelligence rather than your own.

gruez a day ago | parent | next [-]

But there's open models that are (pessimistically) 1 year behind? It's not like if openai decided to rugpull everyone, we'd be going back to writing code by hand and all the developers who forgot how to fizzbuzz would be screwed.

benterix a day ago | parent | next [-]

> we'd be going back to writing code by hand

Well, as as SWE who writes code by hand and has no intention to outsource their intelligence to any entity, I felt slightly offended by "back".

nightski a day ago | parent [-]

Are you a member of a team? Then you are the outsourced intelligence. Your manager is not writing everything by hand, they are outsourcing it to you. Just understand that may change (I mean I am already mentally prepared for it to be a thing of the past within years). If you are purely writing software for hobby/fun then disregard, nothing will stop you from doing that.

benterix 5 hours ago | parent [-]

I have no problem with other people outsourcing their intelligence to me, I've been doing this for years. But I prefer not to outsource my intelligence, at least not for things I care about, for various reasons.

ghostly_s a day ago | parent | prev | next [-]

Open models still need compute.

0cf8612b2e1e a day ago | parent [-]

Open AI rents compute. It seems unlikely given the huge investments they have already spent that they can profitably match someone who is just selling GPU time.

dgellow a day ago | parent | prev | next [-]

Open weight models are way closer to frontiers than that

fny 20 hours ago | parent | prev [-]

An open model is not your brain.

zulux a day ago | parent | prev | next [-]

There's an escape valve: I've had Claude stand-up AI-enabled features in my app, so we're much less dependent on Claude itself. The app uses cheap API calls to check code quality and run other "lessons learned" sweeps. Some of these become regular code in the end as well.

vidarh a day ago | parent [-]

Same. Claude "loves" writing tools to make checks deterministic so much that I actually have to pull it back sometimes and point out that some things need to keep using LLMs. But even then, I have it "farm out" a lot of things to scripts using dirt-cheap models for things I don't need a Sonnet or higher level model for as well. The proportion that runs on the SOTA models keeps dropping.

catchnear4321 a day ago | parent | prev [-]

I reject your intelligence and substitute my own?

flir a day ago | parent | prev | next [-]

Or more efficient models/faster hardware close the gap between here and profitability.

I wouldn't be surprised if every $10 you add to the subscription cost halves your audience.

mrweasel a day ago | parent | next [-]

That boils down to who the customers for ChatGPT really are. $10 isn't going to make a difference for those who already pay, because they are basically pro-consumers. OpenAI might deliver enterprise solutions for large companies, but those deals are besides the per month subscriptions on the website.

For ChatGPT I really only see two customer groups, pro-consumer and small and medium enterprise. The entry level are just going to use Google/Gemini for the most part, or some ad supported ChatGPT tier. There's no price low enough to make the entry level, average consumer pay for an AI service. These are people who will not pay for search, email and social media. They only pay for streaming because there's no way around it.

flir 21 hours ago | parent [-]

Ok half was an exaggeration, but I think $10 might make quite a lot of them jump to Claude. Or DeepSeek. Remember, we're talking about a global user base here.

I settled on GPT Plus/Codex for my own work, while my employer settled on Claude on Bedrock (where I am, according to their metrics, using about $20 of compute a day, so I can believe that GPT Plus is a loss-leader). If I hit too many 5-hour timeouts I'm not jumping to Pro I'm jumping to Claude.

(Funnily enough, I just hit one. It'll reset in... three hours. I wasn't even hammering it, just writing some tests. I think I'm gonna just go reactivate my Anthropic account for a month).

mrweasel 10 hours ago | parent [-]

I'd agree that $10 can and will make users switch to a different provider. Just as streaming music services are all price basically the same, as to avoid users just jumping to the cheapest, I think the AI companies will find a suitable price point for consumer AI. After that they'll just settle into a system where when one raise or lower their price, the rest will follow.

Those who benefit from using and LLM will continue to pay for one, regardless of provider, regardless of the price being $20 or $50.

The global aspect is interesting, because $50 is a lot of money for most of the global population. The AI advocates claim to be getting more hundreds, if not thousands, of dollars of value from their subscription. In the poorest countries that should make an even greater difference, but that assumes that they can get those first $50 and that the value is actually being generated.

ForOldHack 20 hours ago | parent | prev [-]

Your intelligence is good, but mine is better. They could easily raise their prices until their user base falls to zero, and the offer steep discounts, but then... so could everybody else. We need to pimp all the speculators until they are bankrupt. Welcome to web 4.0b. "We will bury you."

TuxSH a day ago | parent | prev | next [-]

It was obvious indeed, but damn does it feel good to have ridden the May 25 - Aug. 26 gravy train.

Now, let's see how the Anthropic IPO goes.

edoceo a day ago | parent [-]

I'm going to predict: soft, below first-trade price at 180d from IPO date.

geraldwhen a day ago | parent | prev | next [-]

They won’t be able to. Open models exist and run on a Mac you can buy now or in October.

howdareme9 a day ago | parent | next [-]

please point me to an open model, that matches astra even on low reasoning, and runs on a mac

dwaite a day ago | parent | next [-]

Why would it need to match Astra?

Software companies don't give up and fold because they can't hire one of the five best engineers in the world.

taylorfinley a day ago | parent | prev [-]

No problem, but you'll need to wait a few months

apparent a day ago | parent | prev | next [-]

The audience for this sort of thing is currently quite limited. It may grow more in the future, especially if prices get out of control, but for now, it's a relatively small subset of people.

esskay a day ago | parent | prev [-]

Sorry but this is a pretty delusional take. No, you cant run the same level or even close to that level of model on a mac, not even on a 512gb studio. You can run good models sure, but not models anywhere close to the capabilities of these ones yet, despite what idiots on Twitter keep spouting.

andybak a day ago | parent [-]

The "run locally" thing is a red herring. The fact that anyone can be an inference providers and offer them as a service is what we need to focus on. If they are "good enough" then market forces will stop Anthropic/OpenAI from charging monopoly rents.

password54321 a day ago | parent | prev | next [-]

It is really about data. The endgame is not about hoping devs give them money.

mrweasel a day ago | parent | next [-]

What are they going to do with that data? Is it ads again?

password54321 a day ago | parent [-]

You are about to get replaced.

mrweasel a day ago | parent | next [-]

Probably not, but I can channel my inner Scotty Fairno https://www.instagram.com/reel/DUbMs8Vipp5/

solenoid0937 a day ago | parent | prev [-]

That's happening anyways, they don't need more organic data for that.

Also, who cares? Such is the price of progress, I'm not selfish enough to hold humanity back because "muh job"

password54321 a day ago | parent [-]

That's great. We are obviously both privileged enough to think that. Not so great for others.

solenoid0937 a day ago | parent [-]

They'll get through it. You don't just halt progress because the transition will be rough. We'd be pre-industrial if we thought like this.

copperx a day ago | parent | prev [-]

More data isn't helping much, if Astra is any indication.

password54321 a day ago | parent [-]

This is just you putting your head in the sand while you gradually automate your job.

flir a day ago | parent [-]

I've spent my entire career trying to automate my job.

(I get what you're trying to say, I'm just finding the irony amusing).

madaxe_again a day ago | parent | prev | next [-]

Or to just give users enough usage to find categories in which it is useful for them.

I pay the $200/mo., and don’t regret it for an instant - I have a project manager, an executive assistant, a business analyst, a software developer and an international accountant, for an absolute song.

dgellow a day ago | parent [-]

you’re using an LLM as your international accountant? And brag about it online? That’s definitely a choice

brazukadev a day ago | parent | prev [-]

As long as there is no path to profitability going from subsidized to fully paid tokens we are making them lose money.

tehjoker a day ago | parent [-]

This is not entirely true, you are costing them in the short run, but are growing your dependence on their product and feeding them training data.

Their goal is to create AGI and replace humans with something resembling the plot of Horizon Zero Dawn and its sequel but more extreme.