What exactly is the average consumer supposed to do with an NVIDIA H100 or GB200?

PowerElectronix 5 hours ago | parent [-]

They can have a pretty good LLM running in there, or cad design. For the average joe, having the free tier of AI without the breach of privacy is pretty good already.

▲

fasterik 5 hours ago | parent [-]

For the average joe, spending $10k on the server-grade hardware needed to run the GPU, plus $100-$200 per month for power is not a great investment.

	▲	iamnothere 3 hours ago \| parent [-]
		The hope is that a crash would lead to fire sale prices, and as for power, you may not need to run your system 24x7 depending on your use case.