I'm a big fan of local models, and moving inference from the cloud to local machines is great, but there's a couple potential problems with this. LLMs take significant (V)RAM resources to run (which is in short supply on consumer hardware), and we don't know that Google won't send local conversation logs to their own servers (kind of surprised if they don't). So if you think you're having a private local conversation in Chrome, I wouldn't be so sure.