| |
| ▲ | embedding-shape 2 hours ago | parent | next [-] | | > Isn't grok currently holding the world record for the biggest generator of CSAM? I'm not sure I see how that's possible, given their image/video generation seems to be heavily censored. Do they have some alternative product besides "Imagine" or whatever it's called, that people use for generating CSAM? Judging by https://old.reddit.com/r/grok (but I haven't validated it myself), it seems like people are complaining more about how censored the model is, than anything else, maybe that's not actually true in reality? There are image models out there with 0 restrictions, even available on HuggingFace or CivitAI, I'm guessing those are way more widely used for things like CSAM than any centralized platform with moderation. | | |
| ▲ | 2ndorderthought 2 hours ago | parent [-] | | Please don't validate any of this personally that would be illegal. I think the proportion of people generating images that way is likely very low. Though I am sure it is possible. Here are some links https://arstechnica.com/tech-policy/2026/01/x-blames-users-f... https://9to5mac.com/2026/02/17/eu-also-investigating-as-grok... Concerning. | | |
| ▲ | embedding-shape 2 hours ago | parent [-] | | > Please don't validate any of this personally that would be illegal. Obviously, I assumed we all are familiar with our local laws to not unwittingly commit crimes here :) > I think the proportion of people generating images that way is likely very low So probably a far cry from "holding the world record for the biggest generator of CSAM" given the amount of local alternatives available? Would be my guess at least, but obviously also hard to know for sure. > Though I am sure it is possible. How can you be sure of this? I've tried just now to get Grok to generate even sexually explicit material with adults, and it's unable to, all of the requests are getting moderated and censored. Are you claiming that instead of prompting "A man and a woman having sex" you put "A man and a child having sex" and then the moderation doesn't censor it? Somehow I find that hard to believe, but as you say, I'm not gonna test that either, so I guess we'll never know for sure. | | |
| ▲ | 2ndorderthought 14 minutes ago | parent [-] | | I have no idea what people are doing to get it to generate illegal content. I only know there are thousands of cases of it via articles about it. I have not, and will not use grok as a product. |
|
|
| |
| ▲ | addedGone 3 hours ago | parent | prev [-] | | Mistral will also tell you how to do ransoms btw from A to Z in automated ways, you are saying they are responsible? I don't get the mix here. | | |
| ▲ | 2ndorderthought 3 hours ago | parent | next [-] | | Yes any company generating csam should not be in business as a legitimate entity. Can you send me a link from a reputable enough source where Mistral models have done this? I didn't even realize they were doing image generation. | | |
| ▲ | pred_ 3 hours ago | parent | next [-] | | > Yes any company generating csam should not be in business as a legitimate entity. At the same time, in this corner of the world, acting Minister for Justice (also known for trying to push through Chat Control), and NGO Save the Children, have been working to make legal the generation of CSAM for law enforcement use. So that would certainly make the industry legitimate, and you would already have a customer. https://www.justitsministeriet.dk/pressemeddelelse/regeringe... | | |
| ▲ | 2ndorderthought 2 hours ago | parent [-] | | I think they key point here is "for law enforcement". That's a little different from "pay me 10 dollars and enjoy the felonies". I still don't feel good about that by the way. | | |
| ▲ | naasking an hour ago | parent [-] | | Would you feel good about completely fake CSAM if it actually reduced incidence of child molestation? | | |
|
| |
| ▲ | addedGone 3 hours ago | parent | prev [-] | | If I send you a convo I've had with Mistral and Claude Sonnet 3.7 that say atrocious things (how to scam, and get away with it, by exploiting dating websites in Thailand, you don't even want to know the next steps trust me when it talks about the UK incorporation by the Thai itself that you brainwash first to send packages safely without customs seizing it and so on), you'll then publicly recognize that both those companies should be avoided and are promoting crime? If we have a deal and you publicly acknowledge it, I'll share you the links. | | |
| |
| ▲ | Hamuko 3 hours ago | parent | prev [-] | | But it's not doing any ransoms, right? Because Grok wasn't instructing users on how to create CSAM. |
|
|
