A small model would be. I think that’s more the point. It’s definitely not SOTA but it’s fast and energy efficient and local.

mdp2021 an hour ago | parent | next [-]

> A small model would be [mobile size]

A ~30mm side for the HC1 tech for an 8b model (still unclear the planned HC2)?

	▲	teaearlgraycold 35 minutes ago \| parent [-]
		Is that analogue or are they baking floating points into the silicon?

wmf 41 minutes ago | parent | prev [-]

Nope, a small model would be larger than the whole iPhone SoC.