Remix.run Logo
EGG_CREAM 3 hours ago

3. Is an interesting perspective, because it’s not at all how I see it. There really isn’t anything for Apple there right now except that they stumbled into making hardware that is perfect for the technology right now. They could a.) burn all their cash and go into massive debt chasing a big foggy question mark that may be entirely overvalued or b.) focus on the hardware right now, wait for the technology to mature and apply it judiciously as applications for it come to light, rather than racing to hamfist it in unnecessary, expensive, and ultimately broken ways.

Siri is useless, so is Alexa and Hey Google or whatever they are calling that. LLMs will change that but cost has to come down to make that feasible. On-device AI would be the gold standard there, I hope that’s not a pipe dream. Apple seems to be positioned niceley for that outcome, if it comes to pass.

jmyeet 2 hours ago | parent [-]

I think there’s a happy medium between doing nothing and burning cash faster than the US military like OpenAI. If I had to pick one company who walking that line the best, it’s Google.

You can wait until improving hardware eventually solves the local LLM problem but imho that’s too passive.

What if someone cracks the problem of splitting LLM inference effectively between local device and server? Think about it. ChatGPT can do calculus. Is that useful to most people? No. Can you currently effectively modularize an LLM and load knowledge on demand? No.

I’m fairly bearish on the use cases for current AI. The biggest is actually just firing people and suppressing labor costs.

But a personas assistant, at least in theory, is something people want, even if it’s just to effectively obey voice commands. If Apple loses to Google here it’s going to be bad for Apple. I think they have to do more than they’re seemingly doing.