That’s too strong of an assertion.

Local models aren’t deterministically equivalent in capabilities to foundation models. Home computers are turing complete; just like a mainframe. They are just slower. Often not slower enough to matter.

▲

sandworm101 4 hours ago | parent [-]

Most people are ok with slower. An AI that lets you edit a family picture, in say 30 seconds, locally is preferable to one that is instantaneous but requires you to submit that picture to examination/storage/training/sale in someone else's AI ecosystem. If i want to crop my ex out of family photos, i should not have to first give that photo to Microsoft. If want an LLM to write a book report for me, i dont want it also alerting my school. And if i write a memo for a client, and i want an LLM to check the spelling, i dont want that memo leaked either.

▲

parineum 3 hours ago | parent | next [-]

> Most people are ok with slower. An AI that lets you edit a family picture, in say 30 seconds, locally is preferable to one that is instantaneous but requires you to submit that picture to examination/storage/training/sale in someone else's AI ecosystem.

Maybe if you ask them that question, but if you show them two products, they'll definitely prefer the faster one. 30 seconds is a long time to watch a progress bar.

	▲	sandworm101 an hour ago \| parent \| next [-]
		Fast and public, or slow and private. Not everyone wants, or is allowed to, share their data with the AI world. And do not doubt that every bit shared with an AI service will be used for training.
	▲	spwa4 2 hours ago \| parent \| prev [-]
		Plus there's the other question. If this thing is slower ... what's the price? The desktop/mini-pc version of this is $3000, after all. At this performance level what is an acceptable price for the laptops? People definitely aren't going to accept more expensive + slower ...

▲

Pxtl 2 hours ago | parent | prev [-]

I'd like to think so but the existence of Google and Apple and Microsoft's cloud based photo tools with phone integration suggests that's false.

You could run a pretty good home server on $50 of gear and yet we never saw any real adoption of OwnCloud/NextCloud style products as an alternative to Google Drive/Photos or Apple Cloud.

Why should LLM/Transformers be any different? Especially when you need a proper expensive GPU to run them instead of a Raspberry Pi?

	▲	thewebguyd 2 hours ago \| parent \| next [-]
		Apple's photo tools run on device, and they'll probably ship more on device foundation models at WWDC too. On-device AI is going to be important, I think. It doesn't have to take the form of a chatbot UI to be useful.
	▲	com2kid an hour ago \| parent \| prev [-]
		After the latest round of cloud storage price increases my non technical wife has been asking if we can do local backups instead...