Every time I see a paper from Apple I just feel like, OK so why isn’t my iPhone actually doing any of this yet?

Why give this to developers if you haven’t been able to get Siri to use it yet? Does it not work or something? I guess we’ll find out when devs start trying to make stuff

▲

imoverclocked 13 hours ago | parent | next [-]

> why isn’t my iPhone actually doing any of this yet?

What exactly are you referring to? Models do run on iPhone and there are features that take advantage of it, today.

▲

jonplackett 11 hours ago | parent | next [-]

None of those features are in any way interesting though. Image playground is a joke, Siri is a joke, that generative emoji thing is a joke.

The AI stuff with photography sure, but that’s more like machine learning.

The photo touch up thing is… useable? Sometimes?

What is it you’ve been so impressed with?

▲

astrange 11 hours ago | parent | next [-]

The main features are text summarization, search, and writing tools.

	▲	jonplackett 27 minutes ago \| parent [-]
		Yes, and these are all pointless. ‘Writing tools’ is there in the text pop up now instead of ‘look up’ even if you’re selecting text on a webpage. It’s just in the way and useless.

▲

smotched 7 hours ago | parent | prev [-]

> why isn’t my iPhone doing any of this yet?

> Ok its doing it in 4 or 5 products, but thats a joke.

Not every AI product is a chatbot.

	▲	aydyn 3 hours ago \| parent [-]
		The joke is that it does it terribly, not whether it does it at all. Wow.

▲

lxgr 8 hours ago | parent | prev [-]

Yes, but why do I have to open a third-party app to do these things when Apple, the company that primarily popularized the entire genre of mobile voice assistants, could very feasibly bake all of that into theirs?

I mean, the thing even lets me ask ChatGPT things if I explicitly ask it to! But why do I need to ask in the first place?

	▲	imoverclocked 6 hours ago \| parent [-]
		Excellent question. I don’t speak for Apple but certainly you can appreciate that there is a fine balance between providing basic functionality and providing apps. Apple works to provide tools that developers can leverage and also tries to not step on those same developers. Defining the line between what should be built-in and what should be add-on needs to be done carefully and often is done organically.

▲

bayindirh 13 hours ago | parent | prev | next [-]

> why isn’t my iPhone actually doing any of this yet?

Probably Apple is trying to distill the models so they can run on your phone locally. Remember, most, if not all, of Siri is running on your device. There's no round trip whatsoever for voice processing.

Also, for larger models, there will be throwaway VMs per request, so building that infra takes time.

▲

lxgr 8 hours ago | parent | next [-]

They just launched "Private Cloud Compute" with much fanfare to enable server-side LLM processing, so between that and the fact that Siri has been server-based for most of its existence (local processing is fairly new), I don't think that's their main constraint at this point.

That said, "Private Cloud Compute" does run on proprietary Apple hardware, so availability might be a concern (assuming they don't want to start charging for it).

▲

jonplackett 13 hours ago | parent | prev [-]

It says there’s 2 models - one local. It’s already released to app developers to use locally I think (it was in the keynote for WWDC).

▲

geoffpado 13 hours ago | parent [-]

The model now available to developers (in beta, not in released versions of iOS) is the same model that powers stuff like the much-maligned notification summaries from iOS 18. So your phone does have features that are powered by this stuff… you may just not be particularly overwhelmed by those features.

	▲	jonplackett 11 hours ago \| parent [-]
		That’s kinda my point though - is this only capable of things like this? If it ia capable of more, why isn’t there something more yet, it’s been a long time waiting…

▲

totetsu 10 hours ago | parent | prev [-]

Apple silicone unified memory is amazing for running things like ollama. You don’t have to wait for them to release their own applications.