I'm not sure his argument holds that foundational models will no longer function after the bubble pops. There's plenty of open weight models that are competitive which are more likely to exist in a world with abundant cheap GPUs.

▲

wrs an hour ago | parent [-]

That is what he said.

>When the AI bubble bursts, there will be stellar bargains on GPUs…

>these standalone models can do amazing things

>The things these open source standalone models can do will only expand, and they will become a given for our computing applications.

I think of the “big” foundation models as the “fossil fuel” of AI. Once the bubble pops and we can’t afford to train any more of them, we’ll be distilling and remixing the ones we managed to make during this weird period where they were feasible.

	▲	4k0hz 21 minutes ago \| parent \| next [-]
		Quaaludes are maybe a better analogy since the original, strong ones are mostly gone and the pills being manufactured today are significantly weaker. And their effect on Wall Street's decision making is pretty comparable to AI's
	▲	epicureanideal 34 minutes ago \| parent \| prev [-]
		Based on my experience, even the models we have now are a huge benefit when properly used. And we probably have a decade or two of significant gains we can make just with harnesses, skills, heuristics, etc. even if no further progress were made on models.