| ▲ | Foundation Models framework(developer.apple.com) | ||||||||||||||||||||||||||||||||||||||||||||||
| 266 points by kermatt a day ago | 35 comments | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | btown a day ago | parent | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
> For those just getting started, developers who are enrolled in the App Store Small Business Program and have fewer than two million first-time App Store downloads can access the Apple Foundation Models running on Private Cloud Compute with no cloud API cost.* https://developer.apple.com/private-cloud-compute/ > Where Apple Intelligence is available, eligible developers can use PCC in their apps distributed on the App Store, and test PCC features via TestFlight or ad hoc distribution. Installs during testing are not counted as first-time app downloads. Is this free tokens? This sounds like free tokens? | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | albertgoeswoof a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on) | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | cj00 a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
I actually think their CoreAI stuff is kind of flying under the radar. But they've got a repo at https://github.com/apple/coreai-models where they're adapting a ton of open weight models to their format to run natively with Swift. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | mcemilg a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
I just realized that claude has also support App Attest for months [1]. Not sure if that is being used widely. Firebase was the most practicle option to call llms directly from ios apps without having fancy setups. I am surprised Anthropic not promoting this more. [1] https://github.com/anthropics/ClaudeForFoundationModels#auth... | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | imagetic a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Why is this up front on HN? Did it get an update? | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | hmartin 15 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Might be a good time to mention, I put together a guide [1] and accompanying skills [2] based on Apple's open source repos [1] https://hbmartin.github.io/Foundation-Models-and-Core-AI-and... [2] https://github.com/hbmartin/Foundation-Models-and-Core-AI-an... | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | _pdp_ a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
I have been using Foundation Models in Noodle for a while and have liked working with it. One part I have not explored yet is Apple Private Cloud Compute but it is on my list. I think I need special entitlements that are only available to Siri desktop app for now - need to check. This is the repo if you are interested https://github.com/pdparchitect/noodle | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | dvdplm a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Can the local model code at all? Eg as the predictor in Zed? | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | cnj 20 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Slightly off topic, but I haven't seen benchmarks or usage tests of the on-device model against other similarly sized models. I know you can only expect so much from a 3B model, but how does it compare to e.g. Gemma 4 E4B or Qwen 3.5 4B? | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | tasoeur a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Curious if it’s possible to use a non-API plan for Claude/ChatGPT with this? It could actually be pretty useful. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | gardaani a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
macOS 27 comes with the pre-installed fm cli command, which is a harness for Apple's local models. Local models run on-device without limits. It's a nice tool to play with — although it does have heavy guardrails. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | einsteinx2 19 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Under the “Model Support” section: > The Foundation Models framework now extends to server models — like Claude, Gemini, and more — all through the same Swift API, with full support for features like tool calling and guided generation Claude, Gemini, and more in eh? Seems like a big one is missing from that explicit list haha. Not a big surprise ChatGPT isn’t directly mentioned given their legal spat, just kind of funny to see the pettiness. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | SwtCyber a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
We've reached the point where Apple is offering a unified abstraction over competing AI providers. Somewhere, a developer is already figuring out which provider-specific feature breaks the abstraction first. | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | okaymac a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Siri AI is too clever!!!!! | |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | okaymac a day ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||
Siri AI is very clever | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | amelius a day ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||||||||||||||
I'll ask my LLM to build me a framework, thank you. | |||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||