Remix.run Logo
MangoCoffee 3 hours ago

OpenAI and Anthropic are both seeking trillion IPOs, while Chinese labs are pumping out open-weight models that are free for US providers to host and monetize.

These Chinese models cost less of US SOTA models to run, even if they are less capable. Providers can just run them, offer cheap tokens, and pocket the margin.

I just don't see how you justify a trillion valuation for US AI labs when the underlying models are being commoditized this fast.

Gigachad an hour ago | parent | next [-]

This is going to be catastrophic.

Whether AI works or use useful or not isn’t even the question anymore. It can fulfil every promise Sam Altman has been making and will still make no financial sense to justify these valuations.

goolz 37 minutes ago | parent [-]

I have already begun winding down my spend on claude and OAI to make room for infra budget. Anecdotal, but I have no doubt a lot of others are doing the same, I very much agree the US players have major issues looming. What an exciting time to be alive!

csomar 5 minutes ago | parent | next [-]

The car industry is also a trillion $$ market in the US. I don't see why that would go any differently from the Chinese cars ban.

netdevphoenix 32 minutes ago | parent | prev [-]

Not exciting for anyone directly or indirectly invested in a frontier lab or its partners. And that is a lot of people, including you.

gruturo 23 minutes ago | parent [-]

No time like the present to pull out and reduce your exposure. I brought this up in my employer's forums 4 months ago and honestly it's been clear even before then. In particular, the upcoming IPOs of both oAI and Anthropic will likely be disastrous for the public - the floor is falling from under them and I don't know if they can be scrappy and work with fewer resources - their internal culture may not support this. We all knew in our hearts they're a commodity - just see how easily you can switch between the 2 of them - and now there are 10 more options costing a fraction.

When Xi Jinping did the announcement of their open weights push, they might as well cancelled their IPOs....

ilaksh 7 minutes ago | parent | prev | next [-]

Most are not necessarily free to host and monetize. At least one of them has a license that says if you are re-hosting the model then you need a license with that company that made the model.

somenameforme 2 hours ago | parent | prev | next [-]

Another interesting potential market here will be 'LLM in a box'. All the hardware and other tooling in a prebuilt, but modular, package ready to go. Pay one up-front cost, get a system running [whatever open LLM] with a token rate of [x], optionally configured to be immediately ready for distributed usage. Basically the opposite of cloud stuff: no rent, no dependency, 100% guaranteed uptime, guaranteed security/privacy (at least subject to your own actions), and so on.

adrian_b an hour ago | parent | next [-]

Palantir already offers a "turnkey AI datacenter", i.e. a rack with "NVIDIA Blackwell Ultra systems with eight NVIDIA Blackwell Ultra GPUs and NVIDIA Spectrum-X™ Ethernet networking for AI training and inference".

It is said that it comes with all hardware and software required to run inference or training with an open weights LLM.

The existence of this product, which competes with cloud-based offerings like those of OpenAI and Anthropic, is presumably the reason why the Palantir CEO criticized very harshly some time ago the business model of OpenAI/Anthropic.

While I doubt that the ethics of Palantir is any better than of OpenAI/Anthropic, in this particular case I have to agree with Alex Karp about "Sovereign AI", i.e. that only losers will make their business completely dependent on an external entity like OpenAI or Anthropic, who are certainly not trustworthy.

vrganj an hour ago | parent [-]

I'm not sure a data center run by ... Palantir of all organizations is what people have in mind when they worry about data sovereignty.

adrian_b an hour ago | parent [-]

They are selling it, not running it.

It is just a dedicated computer system, which should be managed by its owner, like any other on-prem servers.

I doubt that it has a good price/performance ratio, but it is a solution for those who feel that they do not want to search, buy, assemble, install and configure every HW/SW component.

jurgenburgen an hour ago | parent | prev | next [-]

> 100% guaranteed uptime

Disagree there but I think this is an interesting idea. We would need to find some more cost-efficient hardware to run it on than Nvidia GPUs.

pulse7 an hour ago | parent [-]

It will come... all big hardware players (Intel, AMD, Broadcom) and dozens of startups (Tenstorrent, etc.) are working on it...

bevekspldnw an hour ago | parent | prev | next [-]

“100% guaranteed downtime when you least can afford it and the support tickets are your problem.”

We’ve a hybrid shop, including hosting our own ML infra, and we save a ton from cloud spend with local ML. Easily one million USD over past three years. But it’s not “free”, you are shifting a lot of labor into your plate.

hypfer an hour ago | parent [-]

And with that also gain institutional knowledge, skill up your workers and attract talent that wants to work on this stuff.

All boils down to short-term/long-term thinking.

gruturo 21 minutes ago | parent [-]

This. People WANT to work on this stuff. And having skilled workers is a precious advantage.

Godsend69 an hour ago | parent | prev [-]

[dead]

miohtama 18 minutes ago | parent | prev | next [-]

There could be soon AI safety regulations that will stop the US to host or use the Chinese models.

0xpgm an hour ago | parent | prev | next [-]

US investors are desperate for the next hypergrowth opportunity. From what I can tell the US economic strategy is to outgrow its debt.

nkmnz 2 hours ago | parent | prev | next [-]

I think at this point the question is: will the US government be willing and capable to justify the trillion dollar valuation for _one_ of the companies via regulatory capture? The US has a workforce of 170m, so 1.7 trillion would come down to 10k per person, or a discounted cashflow at 3% of 25 USD per month - not including private use, students etc.

kaashif 2 hours ago | parent [-]

Why would you restrict to the US workforce? ChatGPT has a billion users.

switchers an hour ago | parent [-]

Because it would be the US taxpayers bailing them out.

chrismsimpson 2 hours ago | parent | prev | next [-]

> Providers can just run them, offer cheap tokens, and pocket the margin.

There’s an assumption that you can spin up the infra and acquire customers within that margin

KeplerBoy 2 hours ago | parent [-]

Which is not unreasonable. Just hosting it in the EU and promising not to retain / sell the data let's you charge a healthy extra and compete in many areas other players can't.

chrismsimpson 9 minutes ago | parent [-]

Keeping SLAs spinning isn’t this trivial

grey-area 2 hours ago | parent | prev | next [-]

It is impossible to justify the absurd private valuations they have given themselves in collusion with investors.

I wish they had tried to IPO because then we’d see the judgement of the market on this. But that’s why they didn’t this year. How long can they keep up the charade that their models are uniquely valuable and on the path to AGI?

me551ah an hour ago | parent | prev | next [-]

I think that explains the race for IPO by the US AI labs, they know that the longer they wait, the less they will be worth.

piokoch an hour ago | parent | prev | next [-]

"I just don't see how you justify a trillion valuation for US AI"

- military applications - financial applications - medical - applied science

In all those cases it is achievable for those who have needed training data, and Chinese are not going to get them easily. US AI Labs are showing: give us the data, we will do wonders, promising "singularity"-level future achievements.

hmmidontknow 2 hours ago | parent | prev | next [-]

Hmm.. how you justify?

Provoking war, this is how the empire "defends" itself, usually.

I just hope that this time it will get stuck in your throat.

sidd_sarkar an hour ago | parent | prev | next [-]

Ok

charcircuit 2 hours ago | parent | prev [-]

I suggest you think why OpenAI was worth billions before ChatGPT. The valuation is not about how the current set of models can be monetized.