Remix.run Logo
fragmede 2 days ago

Google's own Gemma models are runnable locally on a Pixel 9 Max so some lev of AI is replicatable client side. As far as Gmail running locally, it wouldn't be impossible for Gmail to be locally hosted and hit a local cache which syncs with a server only periodically over IMAP/JMAP/whatever if Google actually wanted to do it.

eru a day ago | parent [-]

Yes, but seems like a lot of hassle for not much gain (for Google).

fragmede a day ago | parent [-]

The gain, as far as local AI goes for Google, is that, at Google scale, the CPU/GPU time to run even a small model like Gemma will add up across Gmail's millions of users. If clients have the hardware for it (which Pixel 9's have) it means Gmail's servers aren't burning CPU/GPU time on it.

As far as how Gmail's existing offline mode works, I don't know.