Remix.run Logo
b800h 13 hours ago

I'm genuinely surprised that more people - including this mathematician in particular - don't untick the "improve the model for everyone" box. Unless the suggestion is that OpenAI ignore this preference?

msy 13 hours ago | parent | next [-]

Given OpenAI's well documented history of unethical behaviour it seems adorably naive to think they actually do that in general, or that they wouldn't pull this particular data separately to generate these proofs.

olalonde 13 hours ago | parent [-]

Unethical doesn't mean irrational. They'd be risking massive lawsuits and a total loss of trust if they got caught lying about this. Doesn't seem worth it.

dgellow 13 hours ago | parent | next [-]

Sounds like exactly what OpenAI would do?

Planktonne 12 hours ago | parent | prev [-]

They've done similar things with similar risks repeatedly.

olalonde 10 hours ago | parent [-]

Example?

Planktonne 5 hours ago | parent [-]

You can read their Wikipedia page [1].

[1] https://en.wikipedia.org/wiki/OpenAI#Governance_and_legal_is...

olalonde an hour ago | parent [-]

These examples aren't really similar. None of those situations involve harming and lying to their own customers.

Planktonne 18 minutes ago | parent [-]

Nonsense; the claim was that they wouldn't do anything that would mean they'd be

> risking massive lawsuits and a total loss of trust

Evidence of the massive lawsuits and lack of trust seems pretty relevant.

afzalive 13 hours ago | parent | prev | next [-]

That doesn't stop them from training on your data apparently. I have that disabled but still has to disable "Don't train on my data" in the privacy center too.

https://privacy.openai.com/policies?modal=take-control

wrvn 4 hours ago | parent | next [-]

Is this claim based on anything besides there being an alternative way to disable it? The privacy center mirrors multiple other functions as well, like account deletion and downloading personal data, but the corresponding buttons in ChatGPT are still doing what they are supposed to.

derangedHorse 9 hours ago | parent | prev | next [-]

I think that flow is an easy way to disable everything, so there isn’t a risk of forgetting to flip one thing back off after accidentally setting it on. I set my ChatGPT environment to allow model improvement for example but had to check my codex settings to make sure ‘Include environments’ for model improvement is off.

I think if I had both on and turned off the ChatGPT setting, ‘Include environments’ has a chance of still being flipped on.

b800h 12 hours ago | parent | prev [-]

If that's true, it's scandalous. The "improve the model for everyone" dialogue states:

"Allow your content to be used to train our models, which makes ChatGPT better for you and everyone who uses it. We take steps to protect your privacy. Learn more"

EnnEmmEss 9 hours ago | parent | prev | next [-]

Even if you've ticked that box, the conversation can still be trained on if you:

(a) Click thumbs-up/down in the conversation [1]

(b) Have the conversation flagged for potential safety concerns

[1]: https://help.openai.com/en/articles/5722486-how-your-data-is....

johnnyApplePRNG 13 hours ago | parent | prev | next [-]

They hide that button. Quite well.

frabcus 13 hours ago | parent | prev [-]

That option is really bad UX - you have to know to do it, you have to know what plan it is needed on. If you're not working in AI, I just don't think that's a reasonable expectation.

Even if you know, in a complex project over years with multiple collaborators, it just needs one person once to fuck up and paste something into ChatGPT and not realise they weren't logged in, to go wrong.

In a proper world, we'd at the very least legislate that AI-training on private data needs consent (in the GDPR sense). It's not consent to go "you didn't uncheck a box that lets me steal everything you've done".

Any training on private data is in my view immoral (it's spying that ultimately will have a chilling effect on even people's private communications). And chats are private data. Unfortunately, it also increases power, so the big tech companies are all doing it.