Remix.run Logo
▲ vatsachak a day ago

This is the most important class of models to keep watch. These are the ones that are going be to workhorses in the post-tokenmaxxing clarity

▲jrflo a day ago | parent | next [-]

Disagree, Opus-tier models are the workhorses. You can get a ton done with them on a $100 subscription.

▲vallerie a day ago | parent | next [-]

And for those on API billing? Opus is still quite pricy for what you're getting done with it.

▲airstrike a day ago | parent | next [-]

> And for those on API billing?

Opus-tier on open models and local hardware.

▲jrflo a day ago | parent | prev | next [-]

If you're on API billing then presumably you're a business, and $1,000 a month is still reasonable for that quality of work

▲szatkus a day ago | parent | next [-]

Those subscriptions won't be subsidized forever. At least not as much as they are today.

▲selectodude a day ago | parent | next [-]

API token inference is subsidizing the rest of the business.

▲cortesoft a day ago | parent | prev | next [-]

People keep saying this, but inference itself is not what is being subsidized. The expense for electricity/hardware/datacenter operations/etc for an inference token is less than what they charge for it, so that cost doesn’t HAVE to go up to be profitable.

The thing that is being subsidized is the TRAINING costs, and that is because they aren’t selling enough tokens yet to pay for the training costs. This is just like most other growth businesses, though, and if enough people use enough inference, it can be self sustaining.

▲scrollop a day ago | parent | prev [-]

Price per token is dropping (though anthropic are doing dastardly things such as using new tokenizers that use 30% more tokens), efficiency will likely increase.

If the subscriptions (of all of the big companies - unlikely?) give a poor amount of value in the future, will move to trusted/open router and use a harness that uses the latest cheap good models for most things, more expensive models as orchestrators.

Already there are non-SOTA models that should be sufficient for most non-coding tasks, and soon for coding, also.

The future is bright, in that respect, without subsidizing the ridiculous IPOs.

▲Rodmine a day ago | parent | prev | next [-]

Or $20 for the same amount of work with US/EU hosted Deepseek flash v4.1.

▲lifeisloving a day ago | parent | prev [-]

[dead]

▲XCSme a day ago | parent | prev [-]

Why stay on API billing? A $200 monthly subscription has a crazy amount of usage and more than enough for a couple of concurrent projects.

▲sz4kerto a day ago | parent | next [-]

Because you can't get subscription if your company has more than 150 users.

▲scrollop a day ago | parent [-]

So they move to non SOTA models.

▲ a day ago | parent | prev | next [-]
[deleted]
▲demibabs a day ago | parent | prev | next [-]

Enterprises with more than 150 seats have to pay API costs.

▲jesperwe a day ago | parent [-]

Or get multiple teams. Just use git instead of artifacts ;-)

▲ a day ago | parent | prev [-]
[deleted]
▲demibabs a day ago | parent | prev | next [-]

For users who pay subscription costs, 100% right.

But for enterprises, who have to pay API costs with no discounts, no way.

▲raincole a day ago | parent | prev | next [-]

Assuming the price would converge to the subscription price, not the API price.

▲vatsachak a day ago | parent | prev | next [-]

They make money on API costs not subscriptions. Subscriptions are not going to last forever

▲agildehaus a day ago | parent | prev | next [-]

Only because you're being heavily subsidized.

▲Rebelgecko a day ago | parent | prev [-]

I thought Opus is strictly worse than Fable now?

▲ltbarcly3 a day ago | parent | prev [-]

I like that you gave an argument and careful reasoning instead of just a vague claim based on common meme about ejaculation.

How is tokenmaxxing like ejaculating exactly? I don't follow the analogy.

▲vatsachak a day ago | parent | next [-]

Here is the argument

1) There was a false narrative called tokenmaxxing whereby one is more productive by spending more tokens

2) This narrative was fueled by discount prices on tokens (which still happens to this day on subscriptions)

3) There is a point where we collectively realize that tokenmaxxing was a state of mind that is not rational for either the consumer or provider

4) We will then pay API prices because LLMs are obviously amazing but no one will offer subscriptions

5) API costs of Opus 5.5 and Fable tier become uneconomical

6) That leaves us in Sonnet/Haiku tier

▲ltbarcly3 a day ago | parent [-]

I understand his assertion, and I can make up an argument that fits it too, probably a few arguments that aren't even compatible with each other, but what you said isn't what he said, you are just assuming all of this, and also nowhere here does it explain how this fits an analogy of "post nut clarity".

▲pixelready a day ago | parent | prev | next [-]

Why is this exchange reminding me of that You Can See Everything documentary?

The analogy made sense to me: Tokenmaxxing policies were the result of an irrational drive by execs who just craved an, ahem, explosion of metrics due to the excitement over new technology. Now that cost sensitivities are setting in, there’s a growing sense of unease that maybe they were in an altered state when they created the mess and now that the excitement has passed they have to clean it up.

▲ltbarcly3 a day ago | parent [-]

So people had this drive to use tokens, and once they experienced the release from using the tokens they went into a refractory period where their reasoning is no longer being overridden by the need to use tokens? And later I guess they'll start to feel more and more of a need to use tokens and this will repeat?

Or is it just a throwaway phrase that makes no sense?

▲pixelready a day ago | parent [-]

We’ll see if the cycle holds true for tokens or LLMs specifically, but for sure there is a larger “new sexy tech” cycle with a strongly emotional output===outcomes metrics irrationality phase to it.

▲ltbarcly3 a day ago | parent [-]

It may well be that tokenmaxxing does not make sense. I don't think people were tokenmaxxing in some kind of compulsive urge to pursue a release of pent up tokens which were making them token horny, followed by post-token-usage clarity as the release of pent up tokens returns them to a baseline mental state. The analogy doesn't make sense.

▲ezrabuenk a day ago | parent | prev [-]

I think he's just saying tokenmaxxing is a temporary hype lol, probably fueled by subsidized subscriptions. When that's over, these cheaper models might get more usage.