Enforcement of anti-CSAM law has been a significant thing for a long time. It's in no way "only now". Even the "free speech" platforms banned it because they knew they would get raided otherwise. There are long standing tools for dealing with it, such as a database of known hashes of material. There's even a little box you can tick in Cloudflare to automatically check outgoing material from your own site against that database - because this is a strict liability offence, and you are liable if other people upload it to you where it can be re-downloaded.

What's new is that X automated the production of obscene or sexualised images by providing grok. This was also done in a way that confronted everyone; it's very different from a black market, this is basically a harassment tool for use against women and girls.

The different factors are scale (now "deepfakes" can be automatically produced), and endorsement. It is significant that all these images aren't being posted by random users, they are appearing under the company's @grok handle. Therefore they are speech by X, so it's X that's getting raided.

There is no content like that on Bluesky nor Mastadon. Show the evidence

I agree that users who break the law must be prosecuted. But that doesn’t remove responsibility from tool providers when harm is predictable, scalable, and preventable by design.

We already apply this logic elsewhere. Car makers must include seatbelts. Pharma companies must ensure safety. Platforms must moderate illegal content. Responsibility is shared when the risk is systemic.

But how would we bring down our political boogieman Elon Musk if we take that approach?

Everything I read from X's competitors in the media tells me to hate X, and hate Elon.

If we prosecute people not tools, how are we going to stop X from hurting the commercial interests of our favourite establishment politicians and legacy media?

You won't find much agreement with your opinion amongst most people. No matter of many "this should and this shouldn't" is written into text by single individual, thats not how morals work.

How? X is hostile to any party attempting to bring justice to its users that are breaking the law. This is a last recourse, after X and its owner stated plainly that they don't see anything wrong with generating CSAM or pornographic images of non-consenting people, and that they won't do anything about it.

> How about "R-Rated" violence like we see in popular movies?

Movie ratings are a good example of a system for restricting who sees unacceptable content, yes.

There are multiple valid reasons to fight realistic computer-generated CSAM content.

Uncontrolled profileration of AI-CSAM makes detection of "genuine" data much harder, prosecution of perpetrators more difficult and specifically in many of the grok cases it harms young victims that were used as templates for the material.

Content is unacceptable if its proliferation causes sufficient harm, and this is arguably the case here.

> I remember when CSAM meant actual children not computer graphics.

The "oh its photoshop" defence was an early one, which required the law to change in the uk to be "depictions" of children, so that people who talk about ebephiles don't have an out for creating/distributing illegal content.

Ok, imagine your mom, sister or daughter is using X. Some random guy with an anime profile picture and a neonazi bio comes in, asks grok to make a picture of them in bikini for the whole world to see, and the bot obliges. Do you see the issue now? Because that happened to literally millions of people last month.

[flagged]

What the hell?

As a father there shouldn’t be any CSAM content anywhere.

And think about that it is already proven these models apparently had CSAM content in their training data.

Also what about the nudes of actual people? That is invasion of privacy

I am shocked that we are even discussing this.

They are not doing anything that is the problem. X just doesn’t care at all.

But they are happy to censor for countries like turkey

Hypocrisy level 1 million

Are you asking to be provided links to child porn?