People want local AI, but only if UX is good. Tooling/harness quality may matter as much as model quality.

I think the future will probably be a hybrid of:

1. local AI for simple, private, everyday tasks

2. online AI for very hard or long tasks

The Clippy app someone made and posted here a while back is the perfect average person LLM interface;

https://felixrieseberg.github.io/clippy/

The UI is already great.

I can’t wait to run my models locally. The sooner I can do my shit without some American mega corp gulping down all my data, the better.