I believe NVIDIA's long term strategy will be to pivot from the data center to the public, and the public will utilize open models on NVIDIA hardware at home. This will come after the RAMpocalypse completes (when the new fabrication plants (China, Tesla/SpaceXAI/Intel) fully ramp up and start selling their RAM for cheap in the next few years). Data centers will be for training mostly.

▲

SV_BubbleTime 2 hours ago | parent | next [-]

There’s a lot about this that would make sense.

But, not really at the current technologies. Kimi and GLM are fucking awesome, but I don’t have 3TB of VRAM to run them, and I don’t expect to even when ram prices drop.

So now you’re back to the scaling issue before talking about power and compute distribution.

▲

charcircuit 2 hours ago | parent | prev [-]

Why do you think the public wants to self host models over using a cheaper solution hosted in the cloud?

▲

Geezus_42 an hour ago | parent [-]

Subscriptions are almost never actually cheaper.

	▲	charcircuit 11 minutes ago \| parent [-]
		It is cheaper to subscribe to AI for $500 a year for the rest of your life than to buy a machine capable of running the a current frontier model with no subagents.