Remix.run Logo
taybin 4 hours ago

It’d be short sighted to not have a wrapper around which AI to use, even without implementation for them. Like, having an abstract parent class with a Siri implementation of it would be baseline good software engineering.

Someone1234 3 hours ago | parent | next [-]

Yeah; plus we know they're designing with potential future local-only Vs. hybrid Vs. cloud-only in mind depending on hardware/market changes. So having it be this flexible buys them a ton of future potential.

People have speculated that with FPGAs or even an ASIC you could take some smaller models we have today, turn the chip into essentially that model-as-hardware, and get some really compelling performance/power-usage characteristics.

At that point running a GOOD quantized Q8 model on a phone is not beyond the realm.

donbox 3 hours ago | parent [-]

Maybe we would get LLMs on (pluggable) cartridges.

pvtmert 3 hours ago | parent [-]

May happen with Android, not going to happen on $AAPL devices... Heck, even the battery is non-swappable!

juiceland 2 hours ago | parent [-]

This is such a funny comment. I’d been hearing about the un-repairability of Apple products for years and I believed it. Then I went to Shenzhen and walked past an entire floor of individuals doing all sorts of “impossible” repairs right in front of the customer.

dlkasajiewo an hour ago | parent | next [-]

My speculation: "impossible" repairs work a lot better when you buy replacements parts for near-market price from a competitively priced seller next door, rather than having to order your parts online from one of a handful of distributors substantially upcharging even for the off-brand version.

fragmede an hour ago | parent | prev [-]

That's "despite", not "because of" Apple.

Grombobulous 3 hours ago | parent | prev | next [-]

I’m not even sure how they would implement these features without them being interoperable. All the AI systems use pretty similar if not identical API standards.

dd8601fn 2 hours ago | parent | prev | next [-]

That exists already for Apple devices. They just never give third party models first class access to user and device data.

That arrangement will change, somewhat, later today.

tiffanyh 3 hours ago | parent | prev [-]

And given how Apple switched out OpenAI for Gemini (to power Siri), they experienced firsthand the importance of having said wrapper.