Remix.run Logo
bensyverson 3 hours ago

I would love to learn more about what's actually powering Apple Intelligence now. Are they using flagship Gemini models behind their own prompts? Fine-tuning? Pre-training their own models based on Gemini?

Is there a meaningful distinction between the Gemini-powered models and Apple Foundation Models? Does that distinction vary for on-device vs hosted models? Are some models running on Apple's Private Cloud Compute and others running on Google iron?

Edit: they elaborated significantly in a "keynote tech-talk": [0]

According to Apple, there are five models:

On-Device

- AFM Core: Dense architecture; the standard next-gen on-device model

- AFM Core Advanced: Sparse architecture, natively multimodal; enables features like image understanding and expressive voices

Private Cloud Compute

- AFM Cloud: Workhorse server model optimized for latency and cost

- AFM Cloud Image: Image generation and editing

- AFM Cloud Pro: Most capable model, Gemini frontier-level quality, for complex reasoning and agentic tasks; runs on NVIDIA GPUs in Google's cloud under Apple's PCC privacy guarantees

Everything excluding Cloud Pro are custom models running on Apple Silicon, "refined" using Google Gemini. About Cloud Pro, they say "this is our most capable model with quality similar to Gemini frontier models." So I might read between the lines and say this is a wrapped Gemini.

  [0]: https://9to5mac.com/2026/06/08/craig-federighi-details-apples-collaboration-with-google-for-siri-ai-in-ios-27/
kube-system 3 hours ago | parent | next [-]

> what's actually powering Apple Intelligence now.

It's a 3B Apple Foundation model.

https://machinelearning.apple.com/research/introducing-apple...

If you've got a mac, you can use this to play around with it:

https://apfel.franzai.com/

djsjajah 2 hours ago | parent | next [-]

I think what they mean by “now” is the stuff announced today.

bensyverson 2 hours ago | parent | prev [-]

It's more complicated than that (see my edit above).

Melatonic 3 hours ago | parent | prev | next [-]

Local is probably similar to Gemma e4b you can get right now on Google Edge Gallery (the ios and Android app). Guessing that the more powerful version that will only work on the 12gb ram devices will be something unreleased that is similar but a bit larger

Google also awhile back announced being able to run full Gemini by leasing / renting hardware in your own datacenters so companies can train or access data without needing to send things to their datacenters. Nvidia based. Guessing Private Compute might just be Apple leasing a ton of those?

wmf 3 hours ago | parent [-]

Apple Private Cloud Compute is running on M2/M3 Ultra. I'm not sure if Gemini Flash can fit in that amount of RAM.

nsagent an hour ago | parent | prev | next [-]

Am I reading this correctly? Their chosen cloud providers run the PCC stack on their hardware, so the compute provider is responsible for ensuring the privacy guarantees? I assume that would add to the potential security surface area.

wmf 25 minutes ago | parent | next [-]

Intel and Nvidia are responsible for enforcing their privacy features. The cloud operator (Google in this case) has no access to any data.

bensyverson an hour ago | parent | prev [-]

Yes, that seems to be the case, and is an evolution/deviation of the original PCC model, which relied on Apple Silicon exclusively.

ErneX an hour ago | parent [-]

https://security.apple.com/blog/expanding-pcc/

pishpash 3 hours ago | parent | prev [-]

Gemini (at least public free version) hallucinates way too much. If it's like that, it can go very badly for Apple.

ComputerGuru 3 hours ago | parent | next [-]

I used Gemini exclusively via the API but downloaded the app last week for something. Even on max settings, it is ridiculously nerfed!

hypfer 2 hours ago | parent [-]

Unfortunately, even the API variant got RLHF'd pretty hard into being that dumb end-user assistant personality :(

But beside that, I feel like the app variant got worse the day they've had that wwdc-style release thing recently.

Previously it was a sparring partner that could actually keep up. But now it just doesn't.

Truly a shame. And nothing that could be fixed by local models any time soon, given that you need the size for the (cross-)domain knowledge.

t0mas88 3 hours ago | parent | prev [-]

The public version of Gemini is ridiculous. At least half their search "answers" are just wrong. If you then start a follow up chat the answers change but usually still half wrong.

Search would be better without the added AI hallucinations above it. If I want an AI answer I'll go and ask Claude, the quality difference is huge.

tonfa 3 hours ago | parent | next [-]

> The public version of Gemini is ridiculous. At least half their search "answers" are just wrong.

That's not Gemini, that's AI Mode (in Search), they're different products built by fairly different part of Google (actually one is built by Deepmind).

(I don't think it's much comparable to https://gemini.google.com/app at least in the past you'd get very different results)

trollbridge an hour ago | parent [-]

And it's extremely poor marketing by Google to do this - the general perception people have is that Google AI is dumb due to this.

dyauspitr 3 hours ago | parent | prev [-]

It has to be really because think of how fast it has to come up with an answer (ie time for a regular google query) and the immense scale of billions of people querying it many times a day, all for free.

pishpash 38 minutes ago | parent [-]

Just like search itself, caching does wonders. What do 90% of the people ask anyway but mundane, totally predictable questions?