If hardware becomes the moat, the US frontier labs are screwed. We have AWS, Azure, GCP. All three have or are making inference silicon. LLMs become just another service in the public cloud's large service catalog, and open weight wins.

Which makes sense to me. Selling a chatbot interface/model access to the general public was never going to be a viable long term play. You still need developers to wrap the models into specialized tools. Queue the Jobs quote "It's a feature, not a product."

▲

KolibriFly 2 hours ago | parent | next [-]

The funniest thing would be if in a couple years LLMs just end up being another checkbox next to PostgreSQL and Kubernetes

	▲	thewebguyd 32 minutes ago \| parent [-]
		I don't think that's far fetched at all either and is probably the end game ultimately. No one wants to buy a chatbot, they want to automate something with it. Intelligence is just another PaaS offering right next to storage, compute. The only hiccup in that happening is will the US Gov let Anthropic and/or OpenAI fail when that time comes.

▲

sdesol 4 hours ago | parent | prev [-]

The big thing is, the western world has moved so much of the manufacturing to China and think a lot of people will not forgive Samsung and others, so I can see China owning a good portion of the supply chain.

▲

johnvanommen 4 hours ago | parent [-]

> The big thing is, the western world has moved so much of the manufacturing to China

I built my career on Solaris and it got rugpulled by Linux.

That wasn’t because of software, it was because of hardware. Linux’s cost advantage existed because Sun hardware had huge margins, because their software was basically free.

AI will probably be a repeat of this. Whoever can come up with the hardware solution that minimizes the cost per token will win.

I believe the 5090 still holds this crown, but someone certainly knows better than I do.

	▲	rescbr 3 hours ago \| parent \| next [-]
		While people fly to the US to buy Macs at a lower price and bring them back in their backpacks, I guess I'll be flying to HK to buy a Chinese GPU rather sooner than later...
	▲	trollbridge 3 hours ago \| parent \| prev \| next [-]
		Fortunately, Solaris skills map to Linux pretty cleanly.
	▲	fragmede 3 hours ago \| parent \| prev [-]
		but not all tokens are equal and vertical integration is the name of the game. Solaris did not lose to Linux, it lost to the LAMP stack on commodity x86 hardware. without the "AMP" part, Linux would've been dead in the water.