Yeah; plus we know they're designing with potential future local-only Vs. hybrid Vs. cloud-only in mind depending on hardware/market changes. So having it be this flexible buys them a ton of future potential.

People have speculated that with FPGAs or even an ASIC you could take some smaller models we have today, turn the chip into essentially that model-as-hardware, and get some really compelling performance/power-usage characteristics.

At that point running a GOOD quantized Q8 model on a phone is not beyond the realm.

▲

donbox 3 hours ago | parent [-]

Maybe we would get LLMs on (pluggable) cartridges.

▲

pvtmert 3 hours ago | parent [-]

May happen with Android, not going to happen on $AAPL devices... Heck, even the battery is non-swappable!

▲

juiceland 2 hours ago | parent [-]

This is such a funny comment. I’d been hearing about the un-repairability of Apple products for years and I believed it. Then I went to Shenzhen and walked past an entire floor of individuals doing all sorts of “impossible” repairs right in front of the customer.

	▲	dlkasajiewo an hour ago \| parent \| next [-]
		My speculation: "impossible" repairs work a lot better when you buy replacements parts for near-market price from a competitively priced seller next door, rather than having to order your parts online from one of a handful of distributors substantially upcharging even for the off-brand version.
	▲	fragmede an hour ago \| parent \| prev [-]
		That's "despite", not "because of" Apple.