The iPhone 17 Pro can run LLMs fast

guidedlight 20 hours ago | parent | next [-]

An LLM-based Siri is expected in early 2026.

https://www.macrumors.com/2025/08/13/apple-smart-home-hub-20...

I wonder if this new Siri would be limited to Pro devices. It would be strange for Apple to release a new feature exclusive for Pro devices that wasn’t mentioned in the September iPhone event.

▲

Drblessing 21 hours ago | parent | prev | next [-]

I'm super excited for the future of local LLMs! By 2030 an 8b model may be as powerful as the top models are today for nearly all consumer usage.

▲

notepad0x90 18 hours ago | parent | prev | next [-]

Look, the tech is cool and exciting and all. But when smartphones started catching on, there were concerns about having actual tracking devices with all these sensors always-on internet connectivity and many of those concerns turned out to be far worse.

LLMs locally on smart devices with access to all the sensors and doing RAG over the internet and all that will also have some dire consequences.

Point being, it's humans that are the problem, that abuse tech. We need lots of laws and regulation yesterday. I don't know what else could be done beyond the destruction of democracy and post-WW2 peace but I'm sure there are people plotting how to abuse this already and no one to stop them.

I'll give you an example, should local LLMs be used to psychologically influence a person's behavior (advertisers would love that!). How about to measure and classify a person for their credit worthiness, job worthiness, potential to support or oppose a political opponent? I'm fairly certain there are people already working on how to influence elections or destabilize democracies with this already.

LLMs aren't new, but their access to phones is. and app makers can say "we're not tracking you" so long as they don't send what they collect off-device. they can just use the LLM to collect indirect information and use personal information to suggest and influence people.

We still don't have nation-wide (good) privacy laws in the US. GDPR and EU privacy laws exist but they're at least a decade behind the tech out there and nowhere near effective at targeting or deterring violators beyond some penalties against big tech.

	▲	20after4 3 hours ago \| parent [-]
		While I agree with what you're saying here, the concern doesn't seem like it is worse when the model is running locally as compared to storing your data in the cloud and running all of the ai models remotely. It's ultimately the same outcome, perhaps local models offer a bit more privacy even if there are other concerns as you've mentioned. It doesn't seem like there is any hope of stopping this, the cat is out of the bag.

▲

dzhiurgis 19 hours ago | parent | prev [-]

Looks just like as fast as 16