Another victim of Goldratt's Theory of Constraints. Some things are more important to optimize for than MATMULs per Watt. What that is I leave as an exercise to the student. May you realize what it is before it is too late.

▲

jazzyjackson 2 hours ago | parent [-]

Some individuals will choose some $10,000 hardware so they can keep freedom and privacy and that's well and good, my point is just that freedom and privacy is not what wins marketshare, and hence, IMHO, local LLMs are not going to catch up and surpass frontier models like some in this thread like to claim

	▲	esseph an hour ago \| parent [-]
		> freedom and privacy is not what wins marketshare Digital sovereignty laws may mandate/remove access to LLMs of other countries on economic and national security grounds.