I think there're a few problems, unfortunately:

- It wouldn't quite work on mobile devices. Many ppl wouldn't like to download 4GB on their iPhone; - Many use cases involve real-time data - e.g. summary of the latest news and events. That would require the LLM to be updated often and be able to perform actions like Google searches; - Switching devices will lose the history, created artefacts, etc.

While I think there're use cases, IMHO, they would be mostly for tech experts and not the wider audience.