Remix.run Logo
dismalaf 2 days ago

What's wild is OpenAI doubling down on hyperscaling when it's obvious that the gains from pre-training are coming to an end. They seem determined to just go out in flames...

mschuster91 2 days ago | parent | next [-]

The thing is, it seems like they are planning to force everyone else out of the market. Acquire all the RAM they can possibly get, leave none for the competition, pray to survive the entire mess.

It's the inevitable peak of the venture capital pipeline, just this time it isn't individual industries (e.g. taxis with Uber, hotels with AirBnB) getting squeezed out by unsustainable pricing - it's the economy at large that's suffering this time.

And it's high time for us as a society to put an end to this madness. End the AI VC economy before it ends our economy.

riskable 2 days ago | parent | next [-]

Perhaps we can call this type of maneuver, "The Sam Altman": Your expensive business's mid-term outlook not looking so good? Why not use all that cash/credit to corner the market in some commodity in order to cripple your perceived competition?

mschuster91 2 days ago | parent [-]

He's not the first one though. The crypto miners used to do the same (I distinctly 'member first GPUs, then HDDs, then ordinary RAM being squoze by yet another new shitcoin in less than a year), and Uber plus the food delivery apps are a masterclass in how to destroy competition with seemingly infinite cash.

kasabali 2 days ago | parent [-]

Crypto miners isn't comparable at all. They were buying finished products and immediately putting them into use.

chairmansteve 2 days ago | parent | prev | next [-]

These gambits never work though. In 6 months you'll be able to get memory chips and GPUs for nothing.....

There's a few historical examples here....

https://en.wikipedia.org/wiki/Cornering_the_market

mschuster91 2 days ago | parent | next [-]

> In 6 months you'll be able to get memory chips and GPUs for nothing.

I highly doubt that. Memory chip production takes years to scale up, which is partially a reason why the memory market (both RAM and solid-storage) is so susceptible to "pig cycles" - high prices incentivize new players to join the market (although less likely than decades ago, given just how much capital one needs and how complex the technology has gotten) and for established players to scale up their production, and then prices collapse due to oversupply.

For GPUs, the situation is even worse. During the GPU crypto mining craze, at least that was consumer GPUs so there indeed was an influx of cheap second hand gear once that market collapsed due to ASICs - but this time? These chips don't even have the hardware for rendering videos any more, so even if GPU OEMs would now get a ton of left over GPU chips they couldn't make general-purpose GPUs out of them any more.

Additionally, this assumption assumes that the large web of AI actors collapses in the next 6 months, which is even more unlikely - there's just too much actual cash floating around in the market.

Y_Y 2 days ago | parent [-]

You can play Counterstrike on a H100 if you really want to.

mschuster91 2 days ago | parent [-]

You can't, it doesn't have any video output port per the product brief [1].

Of course, if one is inclined, I'd take a wild guess and say you could try something like Steam Remote, but I wouldn't bet on that actually working out. And even if you could get it working - per an analysis of German newspaper Heise, the bloody thing has less shader compute capacity than the iGPU of AMD's Ryzen CPUs [2]. 30.000€ - and it'll probably struggle running GTA 5.

[1] https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...

[2] https://www.heise.de/news/Nvidias-H100-kommt-im-deutschen-Re...

Marsymars 2 days ago | parent | next [-]

Just use an AI to describe the Counterstrike scene to you!

Y_Y 2 days ago | parent | prev [-]

That's a funny way of saying you don't know.

Y_Y 2 days ago | parent | prev [-]

!RemindMe six months

Of course I'm joking, there are LLMs to check these things now.

dismalaf 2 days ago | parent | prev | next [-]

This is a huge Hail Mary... IMO they'd be better served slowing down the training pipeline, becoming profitable now, hiring a bunch of scientists and figuring out the next AI technology.

compass_copium 2 days ago | parent [-]

Agree with step 1 here but steps 2 and 4 are a total pipe dream

zb3 2 days ago | parent | prev [-]

Was this market manipulation legal? If so, that's crazy..

mschuster91 2 days ago | parent [-]

Oh, both Uber and AirBnB did get dinged by the courts - but it took them years and the damage was already done, on top of that the fines were laughable.

We need the corporate death penalty aka forced dissolution for egregious cases of misbehavior, we need easier ways to pierce the corporate veil (and I'm more and more inclined to actually support the death penalty here as well, despite the potential for abuse), we need corporate fines to all be measured % of gross income, at least double the profit margin.

And we need all of that fast.

foobiekr 2 days ago | parent | prev [-]

What other option do they have?

This is a "the horse might sing" situation for the whole market that focused on breakthrough-level results (AGI, ASI, or even just "not going off the rails after the third response").

seg_lol 2 days ago | parent [-]

So if it "works" out for OpenAI, not only do they have all the ram, power, water but they also have all the jobs.