While this is a valid take, I feel compelled to point out Chuck Tingle.

The sheer amount and variety of smut books (just books) is vastly larger than anyone wants to realize. We passed the mark decades ago where there is smut available for any and every taste. Like, to the point that even LLMs are going to take a long time to put a dent in the smut market. Humans have been making smut for longer than we've had writing.

But again I don't think you're wrong, but the scale of the problem is way distorted.

People are already addicted to non-interactive pornography so this is going to be even worse.

> And what if you are over 18, but don't want to be exposed to that "adult" content?

Don't prompt it.

That's why laws against drugs are so terrible, it forces law-abiding businesses to leave money on the table. Repeal the laws and I'm sure there will be tons of startups to profit off of drug addiction.

If your goal is to make money, sure. If your goal is to make AI safe, not so much.

It's not just chat. Remember image and video generation are on the table. There are already a huge category of adult video 'games' of this nature. I think they use combos of pre-rendered and dynamic content. But really not hard to imagine a near future that interactive and completely personalized AI porn in full 4kHDR or VR is constantly and near-instantly available. I have no idea the broader social implications of all that, but the tech itself feels inevitable and nearly here.

It will be an even bigger market when robotics are sufficiently advanced.

My main concern is when they'll start to allow 18+ deepfakes

That market is for local models right now.

Even when you're making PG content, the general propriety limits of AI can hinder creative work.

The "Easter Bunny" has always seemed creepy to me, so I started writing a silly song in which the bunny is suspected of eating children. I had too many verses written down and wanted to condense the lyrics, but found LLMs telling me "I cannot help promote violence towards children." Production LLM services would not help me revise this literal parody.

Another day I was writing a romantic poem. It was abstract and colorful, far from a filthy limerick. But when I asked LLMs for help encoding a particular idea sequence into a verse, the models refused (except for grok, which didn't give very good writing advice anyway.)

If you don't think the potential market for AI sexbots is enormous you have not paid attention to humanity.

There is a subreddit called /r/myboyfriendisAI, you can look through it and see for yourself.

Porn has driven just about every bit of progress on the internet, I don't see why AI would be the exception to that rule.

according to the age-prediction page, the changes are:

> If [..] you are under 18, ChatGPT turns on extra safety settings. [...] Some topics are handled more carefully to help reduce sensitive content, such as:

- Graphic violence or gore

- Viral challenges that could push risky or harmful behavior

- Sexual, romantic, or violent role play

- Content that promotes extreme beauty standards, unhealthy dieting, or body shaming

There is a huge book market for sexual stories, in case you were not aware.