Remix.run Logo
swingboy 10 hours ago

Does “the best machine for AI use” apply here considering these models are still server-side?

embedding-shape 10 hours ago | parent | next [-]

The play here seems pretty evidence, if I may assume. Apple creates an interface that is generalized enough so you can easily swap models, and while Claude is preferred by Apple today, it may be any provider or even local models in the future, and the APIs the developers use remain the same, so "migration" becomes easier.

ABS 8 hours ago | parent | prev | next [-]

for the on-device model, yes it runs on the Neural Engine (at the moment) so a newer chip means faster, cheaper local inference. For the server side path this Claude package is about your machine is irrelevant since it's a network call. The same API covers both, so "best machine for AI" only bites when the session is actually local.

But we can imagine that the balance of what's on-device vs what's remote will move continuously towards the former as time, improved HW and improved local models keep progressing

brookst 10 hours ago | parent | prev | next [-]

I would think so, as “use” doesn’t specify implementation. If you use a word processor it may be running locally or remotely.

From a user’s perspective, it doesn’t matter.

sqquima 9 hours ago | parent [-]

[dead]

WorldMaker 6 hours ago | parent | prev [-]

Apple's been trying to make the marketing appeal that "Private Compute Cloud" is also a hardware project. Given it seems to rely on low level details of device Hardware Security Modules, it's maybe even at least a little bit more than just "marketing spin".

5701652400 2 hours ago | parent [-]

looks like it is not "Private iCloud Compute" at all.

Anthropic literally says "Requests go directly from your app to the Claude API; Apple is not in the request path and does not see prompts or responses." — Apple straight up lied

Tagbert an hour ago | parent [-]

No, that post is about Claude for Foundation Models. That is not the same as Apple Intelligence.

the Swift package for Claude for Foundation Models is about sending calls to Claude. That had nothing to do with Apples models which do use local models and models on Private Cloud Compute.

Your accusation that "Apple straight up lied" is based on misunderstanding TFA.