Remix.run Logo
luk212 3 hours ago

Very Apple-ish approach to AI catch up: wrap an external tool in a privacy architecture, embed into the OS and productize the orchestration layer.

It will be interesting to see if the Private Cloud Compute + on-device routing can make third-party model capabilities feel like a first-party system without leaking user context to the model provider.

If Apple handles the Google-Apple boundary right, this will be an elegant move on their part, otherwise it will feel like Apple Intelligence with a just a privacy-polished frontend for Gemini.

dofm 2 hours ago | parent | next [-]

Is there a meaningful Google-Apple boundary in operation?

They are buying the right to distill their own Gemini models and run them in their data centres (or at least data centres they control); unless I am missing something, this isn't going to be infrastructure that Google has operational control over.

janalsncm an hour ago | parent [-]

If Apple is running the inference from Apple iPhones and Apple data centers then Apple has operational control. Google’s influence ends the moment they hand the weights over to Apple.

impulser_ 43 minutes ago | parent | next [-]

They are using Google Cloud.

https://security.apple.com/blog/expanding-pcc/?linkId=100000...

"Now, we are collaborating with Google and NVIDIA to run new Apple Intelligence workloads on Google Cloud, extending our industry-leading PCC privacy commitments to third-party data centers for the first time."

dofm 39 minutes ago | parent [-]

That is news — I guess not very surprising that they'd need more data centres than before.

But again there is no Apple-to-Google transfer in the inference in the sense of the comment I was originally replying to (I am not suggesting you're implying otherwise, obviously)

But I stand happily corrected where I said they aren't in the picture at all.

That is an interesting press release because it outlines what they would have had to do with any data centre they were outsourcing to.

impulser_ 37 minutes ago | parent [-]

This is probably why Google had to rent compute from SpaceX. They needed to free up NVIDIA GPUs for Apple so they probably moved internal workloads to SpaceX compute.

dofm an hour ago | parent | prev [-]

Right — I suppose I mis-phrased my first sentence a bit, because I guess it can be interpreted as me saying the boundary is blurred, when what I was trying to write is: in operation there is nothing crossing any boundary; Google are not in the picture.

al_borland 3 hours ago | parent | prev | next [-]

As someone who doesn't use Android, they showed a lot of integration into the apps, which I think is where the real magic happens, and it's not something I can do with any 3rd party chatbots today (that I'm aware of). I also don't know that I would trust the other 3rd parties with the access required to pull it off.

xattt 2 hours ago | parent [-]

If anything, having Shortcuts built-in at the OS level was a very long play that’s going to pay off.

toddmorey 2 hours ago | parent | prev | next [-]

I'm interested in how it feels to use: whether there is any context leaking, as you mentioned, if it introduces latency, and whether there are any pricing implications? I know they weighed a variety of factors, including the smaller models, but cost had to be a big concern, too... I feel like Google is the only provider giving away so much AI inference for free.

This will further blur the picture about when and how consumers / employees are supposed to pay for AI services. For example, they showed consumer rather than coding tasks, but could you select five files and ask Siri to write a Python script or a small app? Will enterprises just disable Siri AI functionality, or will they be able to route it through their own AI auditing and providers?

2 hours ago | parent [-]
[deleted]
scosman 2 hours ago | parent | prev | next [-]

> just a privacy-polished frontend for Gemini

I'd use this.

I'd rather have strong privacy guarantees, but this is still good.

aorloff 2 hours ago | parent | prev | next [-]

Oh yes Apple "wraps" their AI in a "privacy architecture" -- you can't use Carplay unless you turn it (Siri) on.

jazzyjackson 2 hours ago | parent | next [-]

“Sorry, I don’t know where you are”

jasonmp85 2 hours ago | parent | prev [-]

How do you expect to use a nav system while driving without voice control?

drusepth 2 hours ago | parent | next [-]

Before you start driving, at stop lights, while waiting in lines, etc.

I don't know how it works on CarPlay but when I turn my car on I have a bunch of suggested addresses (home, work, parents, recent Maps searches, etc) that I just touch-to-go. Having to use voice every time you want to navigate not only sounds unnecessary, but cumbersome.

geden an hour ago | parent [-]

Oh so exactly like Apple Maps via Carplay then.

yunwal 39 minutes ago | parent [-]

Yep, shouldn't require Siri at all

doikor 2 hours ago | parent | prev | next [-]

Put in the destination before start driving?

CarPlay does not work at all if you have not enabled Siri. As in it won’t even connect.

00kevn 32 minutes ago | parent [-]

No sense of adventure

preg_match 2 hours ago | parent | prev | next [-]

You don’t need to enable Gemini or voice assistant on android to use android auto. Some functionality is lost, of course, but you can still navigate and play music.

wuliwong 2 hours ago | parent | prev | next [-]

I almost never use Siri in my car and use a "nav system" every time I am driving.

trollbridge 2 hours ago | parent [-]

Very American point of view...

2 hours ago | parent [-]
[deleted]
az_reth 2 hours ago | parent | prev | next [-]

I set it before I start moving, and then don't touch it while in motion.

adastra22 2 hours ago | parent | prev | next [-]

I never use Siri when using CarPlay? I’m confused by your question.

artursapek an hour ago | parent | prev [-]

I use Carplay all the time and I didn't even realize it has voice control. I just set things up on my phone and drive.

paulddraper 2 hours ago | parent | prev | next [-]

All I know is that Siri is a terrible user experience.

AgentMasterRace 2 hours ago | parent | prev [-]

[flagged]