Remix.run Logo
glimshe 3 hours ago

How much are we going to pay for "AI kits" once the DRAM shortage is over? Will we be able to run a local model equivalent to the current AI frontier in sub $1000 hardware, even if dedicated, in 5 years?

url00 2 hours ago | parent | next [-]

Yeeeeep. There is no moat at the moment. AI companies are trying to dig one as fast as they possibly can. Either through passing laws to prevent local inference ("It's too dangerous! We need to control it") or by creating/limiting possible integrations (locking down OS/hardware, APIs/MCPs that only work with Claude/ChatGPT, etc).

yomismoaqui 2 hours ago | parent [-]

Good luck trying to enforce those laws outside of the USA. And in the future China will be happy to sell local inference hardware at competitive prices.

Open, cheap & good enough will win the race.

moelf 3 hours ago | parent | prev | next [-]

frontier to laptop runnable open weight so far seems to be ~2 years latency, so maybe there's some hope

tracker1 2 hours ago | parent [-]

For that matter, just getting Chinese DRAM into the market could cool pricing down a lot to oppose the cartel.

wmf an hour ago | parent [-]

No it won't because Chinese DRAM manufacturers have relatively low capacity and it's already being used. And in an auction, prices from different suppliers converge.

tracker1 2 hours ago | parent | prev [-]

When this hardware was announced, it was expected to be in the $1200-1400 range new... so, maybe. The real question is will the powers that be let this bubble burst, and how painful will the fallout be... I have a feeling it will be worse than 2001-2002.