Remix.run Logo
gehsty 7 hours ago

This kind of thing just makes me think Apple will get to a point where they have good enough local models and good enough harnesses for doing things, and most normal people will just use them… Does the LLM become another interface to computing?

ibero 7 hours ago | parent | next [-]

i agree.

i believe that for most people on the street, for most tasks, a Chat GPT 3.5 era LLM is sufficient enough. sprinkle in tool calling and other things, and that becomes enough. if you can prioritize that level of a model on-device (baking it in etc), then you can bifurcate AI users between those unwilling to pay and those who are willing to pay A LOT for frontier model performance.

SOLAR_FIELDS 6 hours ago | parent | prev | next [-]

This question hinges on whether model advancement plateaus enough for machine sized models to compare to frontier performance. If it does, the answer is yes. If it doesn’t, the answer is no

cptskippy 6 hours ago | parent [-]

More likely, it's going to be whether frontier models advance enough that most people would be willing to pay for them. Right now they don't, but a model you can run locally for free on hardware you already own is very compelling because, while they're not as good as Frontier Models, they're still pretty good.

Tools like Opencode demonstrate that when you box them in tightly enough they can actually be pretty competent.

c7b 5 hours ago | parent | prev | next [-]

Neural machines were always going to be an alternative computing paradigm to von Neumann machines. Had it not been for Minsky we would arguably have gotten to a point where they're useful sooner. But why do you say that as if it's a small thing?

ls612 6 hours ago | parent | prev | next [-]

I have thought this for a while. Computing 1.0 meant that we needed to learn the computer’s language to interact with the computer fully. Computing 2.0 is that now the computer has learned our language instead.

7 hours ago | parent | prev | next [-]
[deleted]
bigyabai 5 hours ago | parent | prev | next [-]

Why wait? People are already doing their work on OpenAI and Anthropic's servers, Apple Intelligence servers could quickly subsume any "local" model work that you want to do.

That way everyone has access, even with older devices, and it's a subscription! Then Apple can tie their APIs into the ecosystem you love at a flat cost you can afford. No need to support local model integration in the first place, problem solved.

chickensong 3 hours ago | parent | prev | next [-]

> Does the LLM become another interface to computing?

It already is.

dominotw 7 hours ago | parent | prev | next [-]

or the other way where primary interfaces ppl use computing arent apple devices like laptops and phones.

doctorpangloss 4 hours ago | parent | prev [-]

based on their apple intelligence demos they are optimizing their products for their core demo of 55-95 year old boomers who talk out loud to think and read every page of the nytimes. you are miles away from the US consumer product experience here.

marcus_holmes 3 hours ago | parent [-]

Boomers were born up until 1965, so the youngest boomer is 61 this year.

Please don't slur us older GenX as boomers.