| ▲ | taybin 4 hours ago | ||||||||||||||||||||||||||||||||||||||||
It’d be short sighted to not have a wrapper around which AI to use, even without implementation for them. Like, having an abstract parent class with a Siri implementation of it would be baseline good software engineering. | |||||||||||||||||||||||||||||||||||||||||
| ▲ | Someone1234 3 hours ago | parent | next [-] | ||||||||||||||||||||||||||||||||||||||||
Yeah; plus we know they're designing with potential future local-only Vs. hybrid Vs. cloud-only in mind depending on hardware/market changes. So having it be this flexible buys them a ton of future potential. People have speculated that with FPGAs or even an ASIC you could take some smaller models we have today, turn the chip into essentially that model-as-hardware, and get some really compelling performance/power-usage characteristics. At that point running a GOOD quantized Q8 model on a phone is not beyond the realm. | |||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||
| ▲ | Grombobulous 3 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||
I’m not even sure how they would implement these features without them being interoperable. All the AI systems use pretty similar if not identical API standards. | |||||||||||||||||||||||||||||||||||||||||
| ▲ | dd8601fn 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||
That exists already for Apple devices. They just never give third party models first class access to user and device data. That arrangement will change, somewhat, later today. | |||||||||||||||||||||||||||||||||||||||||
| ▲ | tiffanyh 3 hours ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||||||||
And given how Apple switched out OpenAI for Gemini (to power Siri), they experienced firsthand the importance of having said wrapper. | |||||||||||||||||||||||||||||||||||||||||