Remix.run Logo
CSMastermind a day ago

Once they capature enough marketshare prices and restrictions are both going to skyrocket. The difference between the subscription usage and API pricing are stark.

jamesriso a day ago | parent | next [-]

This is interesting to think about. There's so much competition among the frontier labs and from outside via open source it just doesn't seem obvious to me they could maintain elevated prices

drob518 a day ago | parent | next [-]

You’re going to get multiple tiers (as we already are). You’re always going to pay top dollar for frontier models, but you’re going to find things highly discounted if you’re willing to move off the frontier. See GLM 5.3 Flash, for instance.

piloto_ciego a day ago | parent | prev | next [-]

It's just doomer nonsense to me.

On the internet you have 4 possible outcomes.

Say things are going to suck and they suck. You look brilliant.

Say things are going to suck, and they don't suck. Nobody cares because it doesn't suck.

Say things are going to be good, and they're good. A few attaboys for getting it right, but nobody cares.

Say things are going to be good, and they suck. You look like a moron.

Because of negativity bias everyone is leaning towards predicting DOOOOOOOOOOM. People aren't even consciously doing this, it's just a factor of the medium, because looking like a moron hurts way more than a few attaboys.

I think in about a year, we're going to see a scad of these ASICS like chat jimmy running year old models on dedicated hardware. Imagine racks and racks full of Astra but running at 15,000 tokens a second or whatever? Imagine swarms of them running the models we have today essentially for "free." That's where we're going to be. The bottleneck will be production, tbh, not demand.

"Hey Astra-Silicon, solve the Goldbach Conjecture!" Sure, it might take a few hours and be totally un-readable to a human being, but the 6m lines of Lean or whatever will be correct. Then what? What can we start doing then?

satvikpendem a day ago | parent | next [-]

Pascal's AI, I see. But yes, social media algorithms and the Internet in general have made people realize doomerism is what gets the clicks and views.

15 hours ago | parent | next [-]
[deleted]
piloto_ciego a day ago | parent | prev [-]

I mean, kind of yeah? But like, there are already people working on the chips, there are already people designing the next hardware, etc. I'm sure we're going to get to a plateau in capability soon-ish? Exponentials are actually all sigmoids. But what does that look like? If the plateau in capability is 100s of times smarter than the average person (arguably we're already there in many many but not all domains) then in 10 years time last year's reasoning model etched into an ASIC or some crazy monstrosity built out of FPGAs but for LLMs is probably way more than enough for 99.999% of use cases?

But yeah, doomerism is the dominant narrative of the day here right now. There's a sort of eschatological poisoning that's happening presently. Nobody can even seem to imagine a world where things get better. It's crazy. Maybe it's because I recently went through a major illness, maybe it's because I hit my head one-to-many times along the way? But I've never been more optimistic about the future than I am now.

missingcolours a day ago | parent | prev [-]

Doesn't seem to have incentivized cryptocurrency enthusiasts away from being in that last category for years...

piloto_ciego a day ago | parent [-]

Crypto never did anything is the difference? The only people it did anything for were speculative investment types.

That said bitcoin is still at like $80k per bitcoin though... so while it's not a good investment IMO (and I don't really mess around with crypto except for the time I got drunk and bought doge and made money), but there are people out there still using it. There's a bitcoin ATM less than a mile from my house.

f30e3dfed1c9 12 hours ago | parent [-]

> Crypto never did anything is the difference? The only people it did anything for were speculative investment types.

Don't forget the criminals. When it comes to crypto, never forget the criminals.

pinkmuffinere a day ago | parent | prev | next [-]

Ya, setting aside any judgement about what's "right", this strategy doesn't seem profitable. There's no real moat between one model/provider to another, switching is relatively easy. I don't understand how this is supposed to work for them.

It strikes me as similar to UPS / USPS / Fedex -- everyone uses the mail, and they mostly use whichever is cheapest for their requirements. I don't think there's much loyalty to specific services, and people are happy to switch between the options

sidrag22 a day ago | parent [-]

just dont fall in love with goofy memory style features and its likely gonna be fairly easy to just plug and play whatever model for a ton of use cases.

I dont see a lot of love for weird memory like features on HN, but on provider subreddits its constantly talked about.

dwaite a day ago | parent [-]

Every project I have tends toward coding agents over time partly for this reason - if nothing else, I want have both control, visibility and portability over memory and a log of the reasoning that went into the current state of things.

fwlr a day ago | parent | prev | next [-]

There is so much competition among frontier labs, but it is a competition to see who can burn the biggest pile of cash. Once your competitors flame out, they are gone, and you are free to raise prices. Think WalMart/Uber tactics.

Den_VR a day ago | parent | prev [-]

It should seem obvious they are seeking governmental intervention to limit “unaligned, or unsafe” alternatives.

KronisLV a day ago | parent | prev | next [-]

This would need to be a collusion across most of the providers (which I think is likely to happen) otherwise OpenAI would get ditched for Anthropic or vice versa, depending on who raises the prices more. If it happens across the board then enterprises that can use Chinese models won’t have that many options but to pay up.

andybak a day ago | parent | prev | next [-]

Where's the moat? You can only truly "capture market share" if there's lock-in and no competition.

CSMastermind 13 hours ago | parent [-]

Harness and data seem like two vectors. It's also not clear to me that at some point we won't get a snowball effect from the platform that has the most use and thus the most training data just running away with a positive feedback loop.

johnnyApplePRNG a day ago | parent | prev [-]

That's the fever-dream that OpenAI et al is fraudulently marketing to their investors I suspect, yes.