Remix.run Logo
embedding-shape 2 hours ago

> Isn't grok currently holding the world record for the biggest generator of CSAM?

I'm not sure I see how that's possible, given their image/video generation seems to be heavily censored. Do they have some alternative product besides "Imagine" or whatever it's called, that people use for generating CSAM?

Judging by https://old.reddit.com/r/grok (but I haven't validated it myself), it seems like people are complaining more about how censored the model is, than anything else, maybe that's not actually true in reality?

There are image models out there with 0 restrictions, even available on HuggingFace or CivitAI, I'm guessing those are way more widely used for things like CSAM than any centralized platform with moderation.

2ndorderthought 2 hours ago | parent [-]

Please don't validate any of this personally that would be illegal.

I think the proportion of people generating images that way is likely very low. Though I am sure it is possible.

Here are some links

https://arstechnica.com/tech-policy/2026/01/x-blames-users-f...

https://9to5mac.com/2026/02/17/eu-also-investigating-as-grok...

Concerning.

embedding-shape 2 hours ago | parent [-]

> Please don't validate any of this personally that would be illegal.

Obviously, I assumed we all are familiar with our local laws to not unwittingly commit crimes here :)

> I think the proportion of people generating images that way is likely very low

So probably a far cry from "holding the world record for the biggest generator of CSAM" given the amount of local alternatives available? Would be my guess at least, but obviously also hard to know for sure.

> Though I am sure it is possible.

How can you be sure of this? I've tried just now to get Grok to generate even sexually explicit material with adults, and it's unable to, all of the requests are getting moderated and censored. Are you claiming that instead of prompting "A man and a woman having sex" you put "A man and a child having sex" and then the moderation doesn't censor it? Somehow I find that hard to believe, but as you say, I'm not gonna test that either, so I guess we'll never know for sure.

2ndorderthought 15 minutes ago | parent [-]

I have no idea what people are doing to get it to generate illegal content. I only know there are thousands of cases of it via articles about it. I have not, and will not use grok as a product.