Remix.run Logo
▲ bri3d an hour ago

Note that this is specifically Consumer Gemini with Connected Apps; Workspace Gemini (and Workspace Intelligence, the RAG thing for enterprise/Workspace) still claims not to be subject to human review:

https://knowledge.workspace.google.com/admin/generative-ai/g...

So basically if you use consumer Gemini and specifically authorize the GMail app, for example, then it will sometimes use the GMail tool to load your mail from GMail, and that data (like all data in consumer Gemini) might be given to the human annotation pipeline.

This whole thing seems deeply stupid to me from Google's standpoint, although they've never been good at product management - there's _way_ too much nuance to what's going on and even if they aren't technically affected, this kind of thing will almost surely make their paying enterprise customers leery.

▲gf74918 23 minutes ago | parent [-]

100% agreed on the Enterprise distinction—this disclosure applies specifically to Consumer Gemini with Connected Apps, not enterprise/edu Google Workspace domains with managed DPAs.

The core concern here is fourfold:

1. *The Walked-Back Commitment:* When Google launched Workspace extensions for consumer accounts in September 2023, they gave an explicit guarantee: personal content from Gmail, Docs, and Drive "is not seen by human reviewers." That isolation promise was quietly stripped in the October documentation updates without proactive notice or re-consent for users who originally enabled the integration under those terms.

2. *Opaque Consent Architecture:* Current onboarding modals for Connected Apps focus on utility while failing to clearly disclose that enabling the connector subjects pulled Drive/Gmail payloads to human review pipelines (as outlined in Help Answer 16836988).

3. *Ambient, Tag-Free Ingestion:* Many users assume Connected Apps only trigger when explicitly invoked via `@Gmail` or `@Drive`. In testing, ambient conversational prompts (e.g., asking about household bills or travel plans) autonomously trigger background Workspace retrieval tools, injecting raw email/document snippets into the session prompt—which then becomes eligible for the human annotation pipeline.

4. *Coupled Privacy Controls (All-or-Nothing Opt-Out):* Unlike OpenAI and Anthropic—which decouple model training/human review toggles from basic application utility like conversation retention—Google bundles human review directly into "Gemini Apps Activity." If a user disables human review, Google disables core features like chat history retention and personalized context.

You're spot on about the brand confusion. When an enterprise employee uses their personal Google account for contractor or side work, or when compliance officers see "Gemini" in headlines, the nuance gets lost fast.