It is a management problem. It’s not because of size. Talk to people who’ve worked there…

Thank you. All these people applauding Apple for not jumping on the bandwagon.

When in reality, they _wanted_ to but have become so dysfunctional organization wise, they weren't able to. Kind of funny how that worked out.

I still think they're really dropping the ball. They could have local models running on devices, interfacing with a big cloud partner (Google, OpenAI, etc.) Make Siri awesome. But no.

▲

user34283 4 days ago | parent [-]

There is no use case for local models.

See Gemini Nano. It is available in custom apps, but the results are so bad; factual errors and hallucinations make it useless. I can see why Google did not roll it out to users.

Even if it was significantly better, inference is still slow. Adding a few milliseconds of network latency for contacting a server and getting a vastly superior result is going to be preferable in nearly all scenarios.

Arguments can be made for privacy or lack of connectivity, but it probably does not matter to most people.

	▲	tracerbulletx 3 days ago \| parent \| next [-]
		I just want it to be able to control my apple home devices and trigger shortcuts, and maybe do a search into a few apps and find things. I know a local model can understand my intent for siri like operations because I literally have my own version of that on my laptop.
	▲	johnsmith1840 3 days ago \| parent \| prev [-]
		I think the real case is a future technology. Similar to speculative decoding but done over servers. Local model answers and reaches into the cloud for hard tokens.