I wish there was some easy way to bet against this happening. I would put a lot of money on the side of this never happening for a multitude of reasons, but I bet I could collect a lot of money from cynics and doomers who think this stuff will happen.

Isn't this how Google operates? I have their AI subscription (about $20 per month). If you want to have a chat history (retain chats after reload) or connect the LLM to Google services (Drive, Emails) you have to activate an option which also allows training. If you don't want to allow training then the subscription is basically useless.

I always pose fundamentalist questions and hypotheticals to the LLM to poison such training data.

Unless your subscription type already comes with a guarantee the data will not be kept or used in training I'd assume the conversations will eventually be used in training regardless how much you paid previously or whether or not you decide to discontinue one day.

I was doing a Udemy course about AI and there was a section where I had to do some processing on randomly scraped tweets and the random tweet that the machine chose to display as an example of something was from a gay porn star and about fisting.

I don't think flat out blackmail will come from LLM companies. It will come from data brokerage companies headquartered overseas.

I'm kind of surprised it hasn't happened already, but I guess there hasn't been enough unscrupulous LLM companies selling those "anonymous" chat logs yet.

> they will be public as paid training data.

Your data is already training data. If they promise to delete everything from their models or those elsewhere that they made the data available to, even if you pay, I'd call them liars.

> (...) your anonymized chats, they will be public as paid training data.

If they are PII then under GDPR they are obligated to delete the data.

If not then they will be liable to pay fines up to $20 million or 4% of their total global turnover.

yeah, i ignored them for years just to see how long they'd play their little game. I finally got sick of it, paid them for a month, downloaded everything, and then canceled/closed the account. Didn't know there was the free option... but oh well. Glad to be rid of them.

So tired of the games everyone plays to squeeze $5 out of someone.

Yes, I'm at fault here with missing the e-mails. The Photobucket account was registered using an old e-mail address that I was using as a kid. I happened to find the account by accident, by scrolling through my password manager.

So these are the unfortunate circumstances. This post basically shows what's it like to be a living and breathing edge-case (missed e-mails & no images in your account).

This actually made me think about the edge-cases I must have shipped at work and how they're affecting people.

I would have had no idea if it weren't for this post. It isn't displayed or acknowledged ANYWHERE on any page, through 3 or 4 pages of "Are you SURE you want to delete your account? You could pay us $5 per month in a different way to pay for 1TB of 'cold storage' instead? How does that sound?"

Only once you get to the final page of account deletion does it give you a single link that says "Request data download" or something.

Or maybe... you know... read