Remix.run Logo
dragontamer 3 hours ago

We can use the GPUs for research (64-bit scientific compute), 3d graphics, a few other things. We programmers will reconfigure them to something useful.

At least, the GPUs that are currently plugged in. A lot of this bullshit bubble crap is because most of those GPUs (and RAM) is sitting unplugged in a warehouse, because we don't even have enough power to turn all of them on.

So if your question is how to use a GPU... I got plenty of useful non-AI related ideas. But only if we can plug them in.

I wouldn't be surprised if many of those GPUs are just e-waste, never to turn on due to lack of power.

cogman10 3 hours ago | parent | next [-]

> I wouldn't be surprised if many of those GPUs are just e-waste, never to turn on due to lack of power.

That's my fear.

The problem is these GPUs are specifically made for datacenters, So it's not like your average consumer is going to grab one to put into their gaming PCs.

I also worry about what the pop ends up doing to consumer electronics. We'll have a bunch of manufacturers that have a bunch of capacity that they can no longer use to create products which people want to buy and a huge backstop of second hand goods that these liquidated AI companies will want to unload. That will put chip manufactures in a place where they'll need to get their money primarily from consumers if they want to stay in business. That's not the business model that they've operated on up until this point.

We are looking at a situation where we have a bunch of oil derricks ready to pump, but shut off because it's too expensive to run the equipment making it not worth the energy.

dragontamer 2 hours ago | parent [-]

That's fine. Server is where we programmers are best at repurposing things. Just a bunch of always on boxes doing random crap in the background.

Servers can (and do!!) use 10+ year old hardware. Consumers are kind of the weird the ones who are so impatient they need the latest and greatest.

throwaway0123_5 2 hours ago | parent | prev | next [-]

> 3d graphics

Seems like the G in GPU is very obsolete now:

https://www.tomshardware.com/news/nvidia-h100-benchmarkedin-...

> As it turns out Nvidia's H100, a card that costs over $30,000 performs worse than integrated GPUs in such benchmarks as 3DMark and Red Dead Redemption 2

jdiez17 3 hours ago | parent | prev | next [-]

I predict there's going to be a niche opening up for companies to recycle the expensive parts of all these compute hardware that AI companies are currently buying and will probably be obsolete/depreciated/replaced in the next 2-5 years. The easiest example is RAM chips. There will be people desoldering those ICs and putting them on DDR5 sticks to resell to the general consumer market.

bee_rider 2 hours ago | parent | prev | next [-]

It’ll be interesting to see what people come up with to get conventional scientific computing workloads to work on 16 bit or smaller data types. I think there’s some hope but it will require work.

themafia 3 hours ago | parent | prev [-]

The government is going to use them.

The flock cameras are going to be fed into them.

The bitcoin network will be crashed.

A technological arms race just occurred in front of your eyes for the past 5 years and you think they're going to let the stockpile fall into civilian hands?

dragontamer 2 hours ago | parent [-]

In 2 years the next generation chips will be released and th se chips will be obsolete.

That's truly e-waste. Now in practice, we programmers find uses of 10+ year old hardware as cheap webhosta, compiler/build boxes, Bamboo, unit tests, fuzzers and whatever. So as long as we can turn them on we programmers can and will find a use.

But because we are power constrained, when the more efficient 1.8nm or 1.5nm chips get released (and when those chips use 30% or less power), no one will give a shit about the obsolete stockpile.

zozbot234 2 hours ago | parent [-]

I assume even really out of date cards and racks will readily find some use, when the present-day alternative costs ~$100k for a single card. Just have to run them on a low-enough basis that power use is not a significant portion of the overall cost of ownership.