If Moore's law continues, then in less than 10 years today's state of the art model will be able to run on a cell phone. How much smarter do we actually need AI to be? Would it still require datacenters and custom hardware?

▲

xnx an hour ago | parent | next [-]

Moore's law stalled ~2015. Unfortunately, no way current models will run on the <100W thermal budget of a cell phone. Printing the weights directly into a chip would help efficiency a lot, but not enough.

	▲	CuriouslyC 44 minutes ago \| parent \| next [-]
		In all likelihood in a few years we'll get ~200-400bA~4-6 MoE models that are on chip, and they'll be better than the current frontier.
	▲	spacebanana7 23 minutes ago \| parent \| prev [-]
		Is it conceivable that in 10 years time we’ll have 7B models that have the same level performance as modern frontier ones?

▲

LightBug1 an hour ago | parent | prev [-]

They probably said the same thing about social media back in the day.

I'm sure the thinking out there, and hence investment, is all about how to tether the user to the most addictive, network-effected, incredibly deep, server-side, moat-able version of AI possible.