> For those just getting started, developers who are enrolled in the App Store Small Business Program and have fewer than two million first-time App Store downloads can access the Apple Foundation Models running on Private Cloud Compute with no cloud API cost.*

https://developer.apple.com/private-cloud-compute/

> Where Apple Intelligence is available, eligible developers can use PCC in their apps distributed on the App Store, and test PCC features via TestFlight or ad hoc distribution. Installs during testing are not counted as first-time app downloads.

Is this free tokens? This sounds like free tokens?

▲

nseggs a day ago | parent | next [-]

Pretty much. You need an Organization developer account, not an Individual account to get the PCC entitlement, but after that it’s pretty easy. I’ve been using it in TestFlight and now a shipping app since WWDC and it’s pretty solid. A lot more performant than I had expected. Context windows could be a bit larger (though it’s much better than the on-device model). PCC usage is allotted to the end users Apple ID or iCloud account , not the app or my development account, which makes it possible to ship a lightweight app and not worry about my own server costs. Some of the background gotchas and PCC rate limiting behaviors are obnoxious but I’ll take what I can get. Some of it is just standard iOS behavior.

▲

edualm 19 hours ago | parent [-]

You can have it with an individual developer account (as long as it's a paid developer account). I have it in mine.

	▲	nseggs 17 hours ago \| parent [-]
		Ah you are correct, I was misremembering the timing of some other account changes I had to make and associating them with this.

▲

SwtCyber a day ago | parent | prev | next [-]

Yep. Though "free tokens" with unspecified daily limits is doing a lot of heavy lifting here. Still, for a small indie app that only needs occasional inference, this could be a pretty big deal

▲

taneq a day ago | parent | prev [-]

This sounds like free samples of tokens.

	▲	MBCook a day ago \| parent [-]
		Not exactly. They’re not your tokens, they’re the user’s tokens. If those are different people. Your app uses tokens when it goes to private cloud compute tied to the user’s iCloud account. I don’t think anyone knows what the limit is, we only know that higher iCloud plans bring higher limits. It’s all very fuzzy right now as this is brand new and I think they’re just trying to incentivize development rather than risk strangling it out of the gate.