Apple should be doing this. Unless their plan is to replace their search deal with an AI deal -- it's just crazy to me how absent Apple is. Tim Cook said, "it's ours to take" but they really seem to be grasping at the wind right now. Go Google!

▲

andrehacker 6 days ago | parent | next [-]

As every other thread about LLMs here on HN points out: LLMs are stupid and useless as is. While I don't agree with that sentiment, no company has yet found a way to "do it right" to the extent that investments are justified in the long run. Apple has a history of "being late" and then obliterating the competition with products that are way ahead the early adopters (e.g. MP3 players, smart phones, smart watches).

▲

yborg 6 days ago | parent [-]

Yes, Vision Pro has really solved VR.

	▲	madrasman 6 days ago \| parent [-]
		It has saved the world from future attempts.

▲

syassami 6 days ago | parent | prev | next [-]

They have a GPT2 like model that's deployed right now for autocomplete https://jackcook.com/2023/09/08/predictive-text.html

▲

Lalabadie 6 days ago | parent | prev | next [-]

By "this", do you mean SLM (small language models)? That's absolutely something they've been working on for a good while.

▲

potatolicious 6 days ago | parent | prev | next [-]

They do. The docs are right here: https://developer.apple.com/documentation/foundationmodels/g...

If you have the latest betas installed you can call those APIs right now.

They also support fine-tuning on the model that ships with ~every device:

https://developer.apple.com/apple-intelligence/foundation-mo...

▲

burnerRhodo 6 days ago | parent | prev | next [-]

steve jobs was the innovator, steve cook is the supply chain guy. They started an electric car not because they thought it was a good idea, but because everyone was going to leave to Tesla or rivian if they didn't. They had no direction and arguements that Tesla had about whether to have a steering wheel...

Then Siri just kinda languishes for forever, and LLM's pass the torch of "Cool Tech", so they try and "Reinvigurate" the team, but with no clear direction. Are they going to be a cloud provider? Are they going to contract out the training? Are they gunna spin up a compute facility even after neglecting to do so since 2012?

Apple needs to just stop trying shit, and just get that app store money. That's why jobs appointed cook. Jobs new cook was no innovator, but he could make apple a money printing machine. Thats what they should stick with.

▲

andrehacker 6 days ago | parent | next [-]

I agreed with that for a bit... and then out of nowhere came Apple Silicon, incredible specs, incredible backward compatibility, nah, Cook is no dummy.

	▲	burnerRhodo 4 days ago \| parent [-]
		He's obviously one of the smartest humans on the planet, but he does seem to lack the ability to force new technologies into existence. He's just cranking the dial on all the KPI's of existing products. Which is an incredibly powerful skill to have, it's just a different skill than what jobs had.

▲

bigyabai 6 days ago | parent | prev [-]

Here's the trillion dollar question: how do you print money when the president wants your hardware onshored and the rest of the world wants to weaken your service revenue?

Solve that and you can put Tim Cook out of a job tomorrow.

▲

burnerRhodo 4 days ago | parent [-]

Well... on shoring the hardware is kinda Cooks specialty. If anyone can do it, he can.

From the service revenue perspective, you can simply play hardball. Threaten to pull out of markets and ensure it's locked in litigation, forever.

	▲	bigyabai 4 days ago \| parent [-]
		Offshoring is Cook's specialty. If he was any good at onshoring then Apple wouldn't be in this position to begin with. It's too late to play hardball, anyways; Europe has already started enforcing their legislation and America's own DOJ has already prosecuted an antitrust case against Apple. There's no more room to give Apple impunity because everyone admit that they've abused their benefit of the doubt.

▲

rs186 6 days ago | parent | prev [-]

Apple will definitely not be doing this. As can be already seen in other comments, the performance of the model is not very good. In fact, you can't really find a model that runs well enough on a phone to provide a good user experience (meaning producing tokens at a reasonable speed without making the phone heat up like a potato, and it's not spitting completely nonsense). Yes I have tried a few.

Think of Apple however you want, but they rarely ship bad/half-baked products. They would rather not ship a product at all than ship something that's not polished.