The vast majority of active users of ChatGPT could successfully use a model like Gemma 4 12B with agentic search if x86 hardware didn't make that so difficult.

Likely even the E4B, which is really both fun and impressive.

That is clearly a big component of Apple's bet, anyway.

I have experimented with it and E4b is perfectly capable of being useful if you provide it with ready–to–use skills.

It's still more like programming than telling a chatbot to go make you GTAVI in JavaScript and make sure the graphics are as good as the original.

Maybe a safer prediction would be that most people will be fine just using hybrid agentic programs that run the models locally(probably with extra spyware). I think this is Apple's bet.