Exactly why does Apple need to do any model training/development? They are out here selling the shovels.

Apple’s Photos ecosystem is privacy oriented and as a result some (now) baseline features require the use of local models.

The Foundation models keep a surprisingly decent set of data available for fast filtering by a local LLM.

I’ve found a slower, second pass, is needed by Qwen to clean it up. (I am running on the new Mac Mini m5 pro 64gb.)

I’ve run my own tests using a date range, a short description of a red cedar planter box build I did last year, and a set of known correct photos.

There is some cool stuff you can do without sending your family’s pics up to any of the frontier model providers.

▲

cj00 an hour ago | parent | next [-]

I've found some strange guardrails with the Foundation models. Like blocking describing of any photo with a single woman in it. It does this relatively consistently but with a different subset every time. Like out of 10 photos in the set, it's skips 6 then the next run, it skips 3. Have you seen guardrail issues like this?

I switched to Gemma 4 instead.

	▲	dominotw 14 minutes ago \| parent [-]
		same i am using new embeddinggemma. seems far more capable than foundation models.

▲

soulofmischief 44 minutes ago | parent | prev [-]

I don't want any of these features and yet they've been forced upon me and are now getting in the way of me actually using my computer how I want. Games and heavy applications slow down and stutter because of "AI" background processes, even with App Tamer, my machine runs too hot to even touch when just idling. Compared to when I got my M2 in '23 and thought, "This is the fastest and snappiest machine I've ever used", my experience with an M5 and the latest macOS version is nothing short of an anti-consumer hellscape.

	▲	doug_durham 2 minutes ago \| parent \| next [-]
		My Macs run cool and silently. I've never observed a background "AI" process consuming resources.
	▲	papa_bear 15 minutes ago \| parent \| prev [-]
		Interesting, this has not been my experience at all. I have an M5 machine and I'm not even aware of what AI features have been added, and it's streets ahead of my old M1 Pro in speed.

▲

MangoCoffee 13 minutes ago | parent | prev | next [-]

Nvidia is also selling the shovle but they train their own LLM and by doing so they can fine tune their CUDA/Chip to have a better shovel than others.

Nvidia's own model does not have to beat OpenAI or any SOTA model. Nvidia just need to build up the in house expert and knowledge to make a better chip since hyperscalers and none hyperscaler like Meta is building their own AI chip now.

Apple can chose not to train their own model to learn how to sell a better shovel.

▲

rswail an hour ago | parent | prev | next [-]

Exactly my thought as I read it.

They make and sell the hardware that will actually make AI something everyone can used without needing to rely on OpenAI/Anthropic et al.

Apple has never had a moat, anyone else could have built this sort of hardware but they haven't.

So they don't care which model wins, because it will always move out to the edge of the network, and they own a large chunk of that edge.

▲

drob518 an hour ago | parent | next [-]

Well, the moat is that cpu/npu development is very hard, requires talented engineers, and requires access to cutting edge fab process, all of which in turn costs a lot of $$$. So, sure, “anyone” who has all that can definitely breach Apple’s moat.

	▲	uurue1 22 minutes ago \| parent [-]
		Ok.. and why specifically do people work at Apple? Hint: money is not the only reason. Jeez.

▲

uurue1 23 minutes ago | parent | prev [-]

Ermmm what?

Apples largest competitive advantage has always been and always will be - trust combined with epic marketing to make the vast majority of people aware of it.

Trust of quality, privacy w.r.t data etc.

I’m sorry but I’ve seen so many bad takes re. Apple over the years. Many of you think you are so smart on topics outside of your domain - but you’re not.

	▲	fasterik 14 minutes ago \| parent \| next [-]
		What exactly about the parent comment is wrong? Apple has always been good at making hardware that people are willing to pay a premium to use. I can easily imagine them playing a similar role in local LLMs to the role they played in smartphones in the 2010s.
	▲	oakejp12 20 minutes ago \| parent \| prev [-]
		> Apples largest competitive advantage has always been and always will be - trust. Lmao > Many of you think you are so smart on topics outside of your domain Turn the mirror around

▲

jorblumesea 44 minutes ago | parent | prev [-]

apple is pretty well set up for this because they do all their hardware in house. if they wanted to, they could pivot in this direction. Ternus is also a hardware guy.