Would you consider adding a mode where it could go online if the user instructed it to?

You can add a web_search tool, checkout what these guys did with Cactus: https://anythingllm.com/mobile