Remix.run Logo
▲ simias 6 hours ago

The problem for me is that it's really hard to project what this industry is going to look like 6 months from now, let alone 6 years.

What's the endgame once the dust settles? Is it going to be a utility like water or electricity and the cheapest offer will prevail, in which case margins will be crushed? Or is Anthropic (or some other big AI lab) going to swallow everything and become the Google Search of LLMs, with everybody else fighting for scraps?

Or is it local compute, models becoming more efficient and hardware becoming cheaper (again) and companies hosting their own AI clusters like they would run SAP?

I think there is a plausible path where this valuation actually works out, but it's a narrow one IMO. I also want to acknowledge that I personally would prefer if it wasn't the case and a more distributed, open model prevailed.

▲jacquesm 6 hours ago | parent | next [-]

I just look at technology over the last 50 years and see: decreasing prices, increasing capabilities. Barring temporary hiccups. Altman & co did a very smart thing by locking up the GPUs and the RAM, they effectively created a temporary near monopoly. At the same time: that incentivized the rest of the world to look more closely at efficiency negating some of the gains of that expense.

It's just like a utility with the slight difference that it can be sold at a distance without significant cost for transportation, in many ways it is the ultimate digital good. Unlike Spotify copyright is not an issue, unlike your electricity, gas, internet or water company there is no last mile problem. Unlike Google there are a ton of qualified contenders already (Google had to be better than Altavista, which wasn't hard, but they were so much better they managed to lock up search for long enough to cement their position).

Anthropic has none of the advantages and all of the disadvantages. On top of that all AI companies seem to be run by megalomaniacs.

▲usrusr 3 hours ago | parent | next [-]

> On top of that all AI companies seem to be run by megalomaniacs.

Not all of them. Only those who outspend all the others and then you never really hear of any others. It's like the most basic requirement for the job.

▲jacquesm 2 hours ago | parent [-]

Fair. I know of at least one other though.

▲bix6 5 hours ago | parent | prev | next [-]

> On top of that all AI companies seem to be run by megalomaniacs.

Isn’t that what it takes though? Doesn’t startup culture celebrate this attitude?

▲jacquesm 5 hours ago | parent | next [-]

> Doesn’t startup culture celebrate this attitude?

Some do, unfortunately. But that's not all of them.

▲mexicocitinluez 5 hours ago | parent | prev [-]

Apple certainly did.

▲dwaite 3 hours ago | parent [-]

Are you speaking specifically to Apple's 6th CEO?

▲butlike 2 hours ago | parent | next [-]

That's Steve Jobs for anyone who wants the answer to this vaguepost

▲jacquesm 3 hours ago | parent | prev [-]

You mean 'He who shall not be named' ?

▲hypfer 5 hours ago | parent | prev | next [-]

> On top of that all AI companies seem to be run by megalomaniacs.

I think this might genuinely going to become a problem for them in the long run. People just absolutely hate their guts. That's a very strong motivator to do everything possible to get rid of them.

We'll of course see in 5-10 years if the doom PR will work out, but that always was a rather high-risk gamble, and it already looks like it might not.

There is a significant amount of businesses and people that are very willing to switch to literally anyone else just out of spite alone.

▲BoxOfRain 5 hours ago | parent | next [-]

It's not necessarily spite as well, it goes without saying that international relations between the US and its allies have deteriorated to the point yet another critical dependency Washington can turn off for geopolitical reasons isn't a very attractive idea for many. While I dislike a lot of Anthropic's behaviour, it was not their actions but the fact their models were subject to export controls which really motivated me to not be dependent on US providers alone.

My country has no frontier models; since I've no national grounds to support one provider over another, a strong degree of provider diversity is an obvious benefit to me. I also think a highly competitive global market is a good thing for mankind in general, any hegemonic power having a monopolistic or oligopolistic position in AI provision is probably the 'bad ending' for most of us since it represents an enormous concentration of democratically unaccountable power regardless of the power which 'wins'. I'd argue it's rational, not spiteful to favour provider diversity on those grounds.

▲unrented7977 3 hours ago | parent [-]

Even inside the US, many businesses are looking at local LLMs because they don't want to get caught by USGOV restricting access to "frontier" AI models.

I really don't see any situation where local AI doesn't absolutely eat the big labs' lunch. They can't compete and the only way it makes any sense for them to exist is if the government somehow tries to ban local AI, which likely wouldn't work in the first place.

▲jacquesm 3 hours ago | parent [-]

That won't stop them from trying, and is exactly why you see all the fearmongering.

▲hintymad 10 minutes ago | parent | prev | next [-]

I don't hate them. They're doing amazing work, and I'd like to believe they're genuinely trying to do good for humanity. I just think it's dangerous for any group of people to think they can impose their morality on everyone (only Dario knows what's right and wrong in military actions, only one company in the world, welfare to the current models, humanity has 10% of chance of getting destroyed by AI, and etc). For that, I'd rather see open-weighted and hopefully even open-sourced models win

▲simias 5 hours ago | parent | prev | next [-]

As a French person myself, I think this antipathy is less strong in non-English speaking countries, where the population (even if they understand English) is less exposed to the antisocial rants of these megalomaniac idiots.

Someone like me who spends a lot of time in the anglosphere puts faces on companies like OpenAI or Anthropic. I doubt that's true for most people, especially outside of the USA. They're just big companies, like 3M, DHL or Toyota. Who knows what the management of these companies think of the future of humankind?

I would expect than personality-driven rejection of American tech from abroad nowadays is driven mainly by Trump and, to a much lesser extent, Musk. Everybody else is just "some guy" to 99% of the population.

▲hypfer 5 hours ago | parent | next [-]

I'm not so sure if that assessment is true, but regardless of that, it also doesn't matter.

Decisions in tooling are not made by the 99% of the population, but a subset that is likely a lot more tuned-in to all this. After all, that is kinda their job so that they can make good decisions

▲simias 5 hours ago | parent [-]

Counterpoint: if that was the case, Musk and Thiel wouldn't as successful as they are.

Our modern capitalist societies are, at the very least, amoral.

▲hypfer 3 hours ago | parent [-]

But isn't that assessment mostly just looking at the 2010s and extrapolating from that?

And back then, the world was very different. ZIRP, cryptocurrencies, infinite highs, peak social media. All that stuff

▲mschuster91 4 hours ago | parent | prev [-]

> As a French person myself, I think this antipathy is less strong in non-English speaking countries, where the population (even if they understand English) is less exposed to the antisocial rants of these megalomaniac idiots.

German here, every stupid utterance of at least the orange clown makes national headlines here. Frankly I wish our populations were more exposed to the utter buffoonery of the rest of the American wannabe elites, maybe people would then not go and type their deepest fears into ChatGPT.

▲atomicnumber3 3 hours ago | parent | prev | next [-]

I know I'm just one person, but I absolutely detest all of the rhetoric coming from these companies and what it means for software freedom - the FSF kind. I ABHOR the idea that free software developers have to either use the hosted (controlled) service, or go way slower than proprietary software devs.

So I'm doing what I can - I only use local models for 100% of my personal coding. (And their capability is amazing! Qwen 3.8 Flash Next leaves me wanting for nothing at this point.)

And I know open weights aren't enough. I'm ready to support open training if/when we get around to that. I hope once hardware prices ease, we can see homelabbers building small AI hosts (small by homelab standards yknow. So let's say 512GB host ram and 1-2 32GB cards, though i hope we also start to see AI cards with lots of vram but less compute cores). Then maybe we can do folding@home style distributed training.

In a time when software freedom is perhaps more threatened than ever, I'm happy to see that information still WANTS to be free, perhaps even more than ever. Look at how easy it is to distill claude! Despite, presumably, anthropic working very hard to prevent it.

▲jacquesm 3 hours ago | parent | next [-]

Homelabbers pooling would be a very nice thing to do and I would definitely consider joining in.

▲natebc 18 minutes ago | parent [-]

As a homelabber, that 5090 I bought a couple years ago for 2k just sold for 9k and I paid off my car.

▲kentm 2 hours ago | parent | prev [-]

What are you using to host Qwen Flash Next right now?

▲atomicnumber3 35 minutes ago | parent [-]

Unsloth studio, on a server that I built in 2024 that was, at the time, ludicrously oversized, but is now just ok-sized to run the q4 quant of qwen flash next. (128GB ram, 16GB vram).

I really want to build something less scuffed, but, yknow. So I'm making do atm.

▲ 5 hours ago | parent | prev [-]
[deleted]
▲ridruejo 6 hours ago | parent | prev | next [-]

This is a great analysis

▲cyanydeez 4 hours ago | parent | prev [-]

The only thing protecting America's AI industry is the cartel of hardware and embargoes against sharing resources. Once those are cracked, they have zero moat. We're talking 1's and 0's at the end of the day, not nuclear engineering or nuclear fusion or some other revolutionary way to increase the value of real property.

▲lotsofpulp 4 hours ago | parent | next [-]

>not nuclear engineering or nuclear fusion or some other revolutionary way to increase the value of real property.

Is engineering the factories that make the hardware not nuclear engineering? Even if not, considering there exists only 1 supply chain in the world capable of making them, it seems pretty revolutionary. And that moat seems pretty big, given that it hasn't been crossed for many years.

▲squidmaster 3 hours ago | parent [-]

[dead]

▲1234letshaveatw 2 hours ago | parent | prev [-]

[dead]

▲skippyboxedhero 6 hours ago | parent | prev | next [-]

The long-term is considerably easier because in the short-term there are limits on supply so prices aren't really able to move in a way where balance will be found.

In the long-term, the marginal cost of a request is zero so prices will plunge and a lot of the fixed investment will get stuck. The difference between the cost of training a model/infra and serving a request from that model is a clear problem for economics.

What happens with Anthropic specifically is less clear because they, as every company in the same position in the last 150 years has done, are going to push for regulation. A lot of the risk has also been shifted onto neoclouds. The value of the customer relationship is, however, effectively zero. A core part of their strategy has been to build stuff out like CC to differentiate that but, ultimately, that won't work.

The other strategy they have employed is trying to get other companies to stop training new models. Again, seems unlikely to work.

There is no scenario in which they become Google search outside of government intervention. Obviously this is a key part of their strategy now but at best, this will only work in the US and Europe (I would actually say they are much further along in Europe where there is a strong tendency towards corporatism and centralisation of power, they could be "Europe's AI").

▲jacquesm 6 hours ago | parent | next [-]

The only thing regulatory capture in the USA will do is to improve the situation for the rest of the world to compete. I wonder how long it will take them to figure that one out, for all their smarts they seem to be incapable of reading a history book.

▲petcat 4 hours ago | parent [-]

> improve the situation for the rest of the world to compete

The risk is that USA and China will come together on a joint "AI non-proliferation" agreement in the same way that nuclear technology became restricted by the countries that already had the capability. This will lead to a de facto techno-colonization of the rest of the world just between themselves.

This was a topic of discussion at Trump and Xi's AI summit just last month.

▲jacquesm 4 hours ago | parent [-]

Neither Xi nor Trump are going to be able to make that stick. The cat is well out of the bag by now.

▲petcat 4 hours ago | parent [-]

Nobody cares about hobby models running on a 5 year old GPU cluster in the basement. This is about industrial-scale AI which, to date, only USA and China have accomplished.

▲jacquesm 3 hours ago | parent [-]

If you think that these are hobby models you are simply saying you haven't used them.

One of the largest legal services partnerships here in NL just launched their local DC so they can maintain confidentiality. Do you think they are 'running hobby models on 5 year old GPU clusters in the basement'? Or does a couple of racks of GB300's sound like maybe they know what they're doing after all?

▲petcat 3 hours ago | parent [-]

That is microscopic scale compared to what we are talking about. From an investor and "market" perspective, the only AI that matters is the one that's built into every iPhone and Google Android phone, every car, every TV, every smart appliance. The AI models that power ships, planes, and all kinds of robotics. The frontier AI that services the energy grid, and even the smart homes and very structures that we dwell in.

This is all on the horizon. We are only barely scratching the surface and right now it is largely hobbyist having fun with it, but we already see the potential of the AI revolution and where it is going.

▲pianopatrick 2 hours ago | parent | next [-]

Seems to me that from an investor perspective, the AI models built into the cars and TVs and other things are likely to be open source. I think long term, due to the high cost of training these models, there is going to be a "Linux of AI". I.e. some model that lots of companies collaborate on and then use for free.

The economic logic is the same as that of operating systems. AI models are very expensive for one company to make, but lots of companies need them. So companies are better off collaborating on that side of things and competing on something else.

Economically, the AI models that require big servers with lots of GPUs in data centers should likely be more interesting to investors than the AI models that can run on local hardware.

▲cman1444 3 hours ago | parent | prev | next [-]

It matters from the perspective of tech dependency.

If a medium/small country deemed it a threat to rely on US/China for AI capabilities, they can get 95% of the utility by banning all American and Chinese models and just using local ones.

This contrasts to something like oil or nukes, where if you're not one of the countries blessed with them, you have a serious power imbalance.

▲butlike 2 hours ago | parent | prev | next [-]

And then a random sun flare like in 1859 wipes it all out

https://en.wikipedia.org/wiki/Carrington_Event

▲jacquesm 3 hours ago | parent | prev [-]

Ah, the True Scotsman of 'hobby labs'.

▲speleding 5 hours ago | parent | prev | next [-]

Although I agree inference will become cheap (probably not zero), it's quite possible that there is a moat they can build around understanding customer context.

With each query OpenAI and Anthropic get more context about their users. When I compare answers between AIs the ChatGPT answer often includes useful things it inferred from earlier conversations. Losing that context could be a meaningful barrier for a customer to switch to a cheaper service.

▲jacquesm 5 hours ago | parent [-]

> With each query OpenAI and Anthropic get more context about their users.

Not unless they break their own TOS. The temptation must be very large to do so and is probably why those settings keep mysteriously shifting back to 'yes, I give all my data to you to do with as you please'.

▲sfblah 2 hours ago | parent [-]

I don't think that's what GP meant. I think the point is maybe they could build a moat by "knowing you" in a way that makes you care about using Claude rather than, say, Gemini.

▲jacquesm an hour ago | parent [-]

I don't actually want them to know me. And if they build a file on me without telling me that's actionable under the GDPR.

▲redanddead 5 hours ago | parent | prev [-]

Wild how even when humanity achieves a level of abundance there’s somehow a need from a few on wall st to create artificial scarcity.

▲jacquesm 5 hours ago | parent [-]

They can't help themselves. They all saw that movie and figure they can be stars too.

▲rayiner 6 hours ago | parent | prev | next [-]

The evidence we have so far points to LLMs becoming commodities. I can’t think of a technology in the last 30 years where so many companies are within ankle biting distance of the leader. There seems to be no data aggregation moat like with Google.

▲Tuna-Fish 5 hours ago | parent | next [-]

Distilling just works too well. It costs much more to aggregate the data in the first place and train the first model, but once that exists and you are selling access, the second guy can train their model by using the first model to generate the training data.

The only ways to fight this is trying to either: 1. Block it by cutting off access, which is pretty tough because it basically means you cannot offer unmonitored access which is a no-no to a lot of customers, and even then the workload looks very similar to actual real workloads and if the company doing the distilling is a bit sneaky and using intermediaries etc it's almost impossible to stop, or:

2. Try to use IP law to block the practice, which is pretty gross given how they got the data in the first place, and so far no court has supported them on this. And even if they can make it illegal, it won't actually help because there are countries that see having top-tier AI as a national priority and will actually support their companies breaking laws to get there.

People misunderstand why Anthropic is being so stingy about granting access to their top models. It's not some kind of marketing ploy, they know that if they release them fully openly then there will be a Chinese open-weights model in 3 months that is just as good. Also the reason why they try to hide chain-of-thought and the probability distributions.

▲butlike 2 hours ago | parent | next [-]

> the second guy can train their model by using the first model to generate the training data

Isn't this somewhat akin to a model learning from its own inputs? Doesn't that behavior lead to model collapse? Either the model is trained on pristine data, in which case it stagnates, or it's distilled from another model, which leads to model collapse.

▲sfblah 2 hours ago | parent [-]

I think the better analogy is kick-starting. Yes, you'd get model collapse eventually, but you can kick-start a new model by cloning an old one and then you start training it like a normal model from then on out.

▲cmiles8 5 hours ago | parent | prev | next [-]

Given Anthropic is basically just “distilling” the IP of others they’re in no position to cry foul when others run the same playbook on Anthropic IP. They can pound sand on that front.

▲jacquesm 5 hours ago | parent [-]

Indeed, the hypocrisy is cringe worthy but the lack of proof makes it a transparent play to stop giving their users the ability to audit the token counts. "Here is your bill. You spent 20% more than last month, but we're not going to show you what you spent it on."

▲ 4 hours ago | parent [-]
[deleted]
▲jacquesm 5 hours ago | parent | prev [-]

Anthropic has made a lot of noise about this but has not offered a shred of proof. CEO about to do IPO is not a trustworthy source.

▲the_sleaze_ 4 hours ago | parent [-]

> has not offered a shred of proof

Pardon me? You cannot be serious...

https://media.defense.gov/2026/Sep/08/2003992823/-1/-1/0/CSA...

▲jacquesm 2 hours ago | parent | next [-]

You have a very low standard for proof.

Independent verification from non-aligned entities would be a minimum for something like this. Note how in spite of all of the claims not a single lawsuit has been filed.

▲tehjoker 2 hours ago | parent | prev [-]

These are more claims of the same kind from an aligned institution. There is no evidence offered.

You cannot believe intelligence agencies when they do not offer proof. Their job is to provide (reputationally but not factually) authoritative story lines that protect big business interests from competition overseas. Sometimes they protect US business by bombing their competitors.

▲koolba 6 hours ago | parent | prev [-]

The interface being arbitrary text makes the moat even looser. The cost of experimentation with alternatives is getting lower and lower.

It’s going to be hard for companies to justify paying $1000s per month to frontier providers when they see what’s doable with open versions.

▲htrp 5 hours ago | parent [-]

multiple thousands per employee sure.... but you will be surprised how much non-compensation employee expenses can be

▲freakynit 5 hours ago | parent | prev | next [-]

I have a little different take..

Top models, capable of discovering and inventing stuff, held back from public, and available only as for-rent research service (or whatever the relevant bureaucratic term is) to big corporations and government agencies like NASA, DARPA, NSF, NIST, DOE, etc. only.

I have a feeling that we, the public, will stop getting access to more intelligent models starting next year.. i mean, not the incremental ones, but, major ones.. like the one you got going from opus 5 to opus 5.5.

▲marsten an hour ago | parent | next [-]

The economics of that don't work out. Government is a small market and can't drive frontier innovation at the scale it's happening today, let alone in the future.

Look at the defense industry: The Big 5 contractors (Boeing, RTX, General Dynamics, Lockheed Martin, Northrop Grumman) capture most of the discretionary military budget, and the largest of them is in the $300B valuation range (Boeing, which has substantial non-government revenue). Fine businesses but nowhere near Anthropic's valuation.

Bottom line, the government doesn't have deep enough pockets.

▲program_whiz 5 hours ago | parent | prev | next [-]

this suffers from the same prisoner's dilemma we already see at play. Any player can defect and in theory capture a "trillion dollar market". Once they IPO, then their service is to maximize (short term) shareholder value. Saying "we reject all the billions in recurring subscription revenue because we are hoping all AI providers will do the same, therefore creating a moat" isn't going to go over well.

▲visarga 2 hours ago | parent | next [-]

The SOTA model dilemma is that you have to pay more and more to train models that focus on less and less of the AI task market, because 95% of tasks can be done by cheap small models.

▲neutronicus 4 hours ago | parent | prev [-]

I think GP's thesis is that selling only to the US government would preserve their moat by preventing distillation.

▲YawningAngel 17 minutes ago | parent | next [-]

If the US government is a monopsony buyer, why would it choose to pay high prices?

▲blackmesaind an hour ago | parent | prev [-]

Also frees up more compute for recursive improvement, and gives them leverage over USG (makes regulatory & legal & other issues disappear) due to the frontier being significantly more effective for military use. There's a lot of chatter around distilled models being "close" to the frontier, but realistically they are optimized only to look good on benchmarks - and are still 6 months behind Anth / OAI models at that.

▲jacquesm 5 hours ago | parent | prev [-]

There is a good chance of that. This will incentivize the rest of the world. Keep in mind that the world is much larger than the USA, that the USA has alienated a lot of parties that were its allies and friends not that long ago and that there are far more talented people outside of the USA than in it. Silicon Valley had the world by the short and curlies and then Trump came along and pretty much burned it all down. It will take another decade to know how big the damage is but it is probably in the trillions of $ of lost income and that's before we get into intangibles.

▲freakynit 5 hours ago | parent [-]

I don't want to make this discussion politicized.. but man... Trump truly burned everything down that the US built over decades of hard work and careful planning. And these things are extremely difficult to build back, especially in a world like today's.

▲ashkankiani 4 hours ago | parent | next [-]

Politics is intertwined with economics and finance. Unless by politicized you meant inviting opinions unrelated to facts. What you stated is a fact. The part that is hard to divine is if there's a larger end goal that justifies the loss of trust.

At this point, the best guess is he plans to deflate the currency to make the debt worthless.

▲GolfPopper 3 hours ago | parent [-]

>best guess is he plans to deflate the currency to make the debt worthless

That might be the best possible intended outcome, but it also seems unlikely that Donald Trump and his government are involved in anything so far-sighted. Just look at the man's public behavior over the last year; either he is an incredible actor, or this is not a government where anyone in power cares about anything beyond the Big Man's whims of the moment and their personal benefit.

▲ashkankiani 2 hours ago | parent [-]

Donald Trump is a puppet for those with bigger around him, but because of his mania and dementia, it's like having to roll a d6 whenever you try to steer him. I think that unpredictability is part of the issue making it hard to extract what the long term play is.

There's also the incompetence of the ones with the longer term plans making whatever is played out more inscrutable. Although they have actually implemented a significant portion of project 2025.

I personally think it's really funny how if you were to try to reverse engineer his motivations based on the actual outcome, then the most likely answer is that he's a joint Chinese-Russian spy based on how much they've benefited from his elections.

▲jacquesm 2 hours ago | parent [-]

I've never seen an individual that was so damaging to the country that democratically elected him. There are others that were as damaging but they were not elected or it wasn't during my lifetime. Trump is unique in that respect, more so because he did it twice.

▲stickfigure 5 hours ago | parent | prev | next [-]

I agree with you but as they say "markets have short memories". After the Ukraine war is over let's see how fast Europe goes back to Russian gas. They're making noises about it now (and parts never stopped).

The world is going to be very different in another two years.

▲celticninja 4 hours ago | parent | prev | next [-]

yes, you are no longer trusted. Europe is lucky that the UK and France essentially told the US to fuck off when they tried to stop them developing their own nuclear deterrent. If they had, then right now the alliance between Russia and the US would put the whole of europe at risk of Putins Russia. As it is the French and UK capability is more than enough to counter the russian nuclear threat. As in we all fucking die if russia launches nukes, but it at leats lets russia know that too.

fuck trump and republicans. and yes whatever goodwill you had built up over the last 60 years was up and away like a fart in the wind when you elected a corrupt pedophile for the second time. And it cant be built back, ever. No one trusts you no to pull the rug if we became reliant on you again. What we will have though is a relationship with allies built on equality rather than one main player calling the shots.

▲panta 2 hours ago | parent [-]

the trust could in theory be built back if they would manage to dethrone him and his cronies, hold a Nuremberg-style trial leaving out no accomplice and reform their system and constitution in order to setup real guardrails that would reliably avoid this from happening ever again. This would require, among other things, to severely limit presidential powers, or better yet, switch to a parliamentary system with a "first minister", and abandon the two-party system in favor of a more democratic proportional multi-party one. Sadly I don't think these changes will ever happen.

▲jacquesm an hour ago | parent [-]

This is pretty much it. I don't think anybody believes these changes will ever happen unless it gets much worse than it is today. I would not rule that out though and 'ever' is a long time.

▲jacquesm 5 hours ago | parent | prev [-]

I haven't been back since Trump I. Missed a funeral of a friend. I still have more friends on the other side of the Atlantic than I have in Europe, even so I don't think I will ever go there again. Enough is enough.

▲npc99 3 hours ago | parent | prev | next [-]

How is it not clear that LLMs are being increasingly commoditized and that the foundation model producers are in a bad race to the bottom with each other AND cheap open-weight competition?

Not even just from Chinese models, but from companies/labs like Mercury

▲eurieq 3 hours ago | parent [-]

Stop spreading lies - for most people they are.

E.g I know people in high finance who switched - they don’t need frontier for many tasks - Anthropic is getting jack all revenue from them.

If the tech improves massively - Anthropic still gets nothing - since firms will want on-prem or cloud offerings that ensure zero data leakage / IP.

You lot haven’t played this out.

▲npc99 2 hours ago | parent [-]

I think you either grossly misread my comment or are responding to someone else, because my position seems to be pretty much the same as yours

▲pantalaimon 4 hours ago | parent | prev | next [-]

I wouldn't bet on local compute. Even if it may end up cheaper in the long run, the convenience of just another SaaS subscription sure beats the high upfront const and continuous maintenance required with local deployments.

We've seen businesses moving everything to the cloud before AI, we'll see more of that as regulatory requirements are increasing.

▲yxhuvud 2 hours ago | parent [-]

I agree that the SaaS solution will be a winner, but the price diff cannot be too big or it would be too economical to run it yourself.

▲rbtprograms 3 hours ago | parent | prev | next [-]

>The problem for me is that it's really hard to project what this industry is going to look like 6 months from now, let alone 6 years.

i keep thinking how crazy it is we went from ChatGPT releasing in 2022 to multi-trillion IPOs 4 years later. the industry still hasn't agreed on how to generally use anything. crazy times ahead.

▲mbesto 5 hours ago | parent | prev | next [-]

I agree it's hard to predict.

It's very possible given the current environment that LLMs go the way of airlines. Low margin businesses that are essential to world economics with heavy price competition.

▲gnarcoregrizz 2 hours ago | parent [-]

and airlines are still finding ways to enshittify. flights included meals, now you're (un)lucky if they include biscoff. and that'll be $50 to check a bag. I can't imagine how frustrating an enshittified LLM would be. hey - I noticed this is a finance-related query. those cost 100% more.

▲jacquesm an hour ago | parent [-]

Variable token cost depending on context is definitely something that's coming if they manage to lock up the market.

▲pianopatrick 2 hours ago | parent | prev | next [-]

It's going to be "all of the above" because AI has a whole lot of use cases.

For certain AI use cases, AI will be like a utility. For other user cases you need to pay a premium for the frontier. For other use cases AI will be local.

Even in the industries you mention (water and electricity) you have all sorts of businesses. Like people selling water in fancy cans for a large markup or batteries vs wall power.

▲throwaway85825 5 hours ago | parent | prev | next [-]

It's going to be all about the training set. Theres no moat in models trained on internet data.

There are tons of private datasets where a model will be fine tuned to provide useful domain specific responses.

▲jacquesm 5 hours ago | parent [-]

And this is why I think companies will wise up and stop sending their information to the likes of Anthropic and OpenAI: they will not be able to maintain their edge if either one of them decides to defect and start using all of their uploaded user data to improve the model. So they have a massive incentive to break their own TOS.

▲throwaway85825 5 hours ago | parent [-]

That's the push factor. The pull is, say there's a giant repo like windows or Adobe. LLMs produce spaghetti code because the repo doesnt fit in the context and it wasn't in the training set. If Adobe fine tuned it the LLM would be much more useful.

▲mattm an hour ago | parent | next [-]

This will be the future model for businesses. Buy a generalized frontier model and finetune it and make it available internally. This model offers a lot more business benefits than the current risk.

▲jacquesm 5 hours ago | parent | prev [-]

I'm running a max of 1M context locally. I think the next real move will be continuous learning/infinite context. That will be another game changer.

▲throwaway85825 5 hours ago | parent [-]

Infinite context requires Infinite memory.

▲jacquesm 4 hours ago | parent [-]

It wasn't a theoretical thing, it was a practical thing. Just like when we talk about 'infinite tape' when looking at Turing machines. As opposed to 'clear boundaries to how much context you can have because that is baked into the model'.

▲celticninja 4 hours ago | parent | prev | next [-]

When google became the king of search the incumbents were so far behind that catching up wasnt possible and they thought their position was entrenched anyway. With LLMs openAI's competitors are at or close to their capability already and everyone knows they need to keep spending to remain relevant. So unless the cash pipeline dries up for competitors that is unlikely to happen. The reason for that is anyone who has invested knows that either they give up and hand everything to their competitors or someone else does. Which means you need to keep spending to outlast your competitors. These companies are too rich and there is too much VC money around and enough billionaires with more money than they and their descendants could spent in many lifetimes, and a huge amount of greed. If the money runs out that is because some very bad shit has occurred and LLMs will be the leats of our worries.

▲koe123 4 hours ago | parent [-]

Google is a bad comparison because they arent charging money. People swap streaming services all the time, analogously.

▲sandworm101 5 hours ago | parent | prev | next [-]

>> What's the endgame once the dust settles?

Given the trillion-dollar spend, the theory is that every many woman and child in the western world will devote a substantial portion of their income (like 5-10%) towards some sort of AI subscription.

or...

That doesn't happen. All the AI investments go south and every man woman and child in the western world will devote a substantial portion of their income (like 5-10%) to bailing out an economic system that went all-in on AI. Either way, the money has already been spent.

▲GolfPopper 3 hours ago | parent [-]

You left out one...

The already shaky economic system (and associated political systems) can't take the strain of every man woman and child in the western world devoting a substantial portion of their income (like 5-10%) to LLM fallout, and we end up with a collapse scenario of some sort. (Which, to be clear, is near-certain to be worse than either of the above.)

▲oddIdentities 6 hours ago | parent | prev | next [-]

>Is it going to be a utility like water or electricity and the cheapest offer will prevail

This

▲ 6 hours ago | parent | next [-]
[deleted]
▲butlike an hour ago | parent | prev [-]

Like ISPs, right?

▲realusername 6 hours ago | parent | prev | next [-]

I don't see a path forward for valuations like Anthropic, either the hardware requirements fall off a cliff (and why would people pay Anthropic so much if it runs on a cheap laptop?) or either they don't and they will never have the capabilities to serve all their customers (and why would they be valued so much then?).

It's a lose/lose situation here for Anthropic (and OpenAI) whatever happens.

▲dvfjsdhgfv 5 hours ago | parent | prev [-]

> Or is Anthropic (or some other big AI lab) going to swallow everything and become the Google Search of LLMs, with everybody else fighting for scraps?

Of all scenarios, based on the data we have now, this seems to be the least likely one.