Remix.run Logo
pogue a day ago

Finally, someone is taking action against the CSAM machine operating seemingly without penalty.

tjpnz 13 hours ago | parent | next [-]

It's also a massive problem on Meta. Hopefully this action isn't just a one-off.

direwolf20 3 hours ago | parent [-]

Does Meta publish it themselves or is it user–generated?

chrisjj a day ago | parent | prev [-]

[flagged]

mortarion a day ago | parent | next [-]

CSAM does not have a universal definition. In Sweden for instance, CSAM is any image of an underage subject (real or realistic digital) designed to evoke a sexual response. If you take a picture of a 14 year old girl (age of consent is 15) and use Grok to give her bikini, or make her topless, then you are most definately producing and possessing CSAM.

No abuse of a real minor is needed.

chrisjj a day ago | parent | next [-]

> CSAM does not have a universal definition.

Strange that there was no disagreement before "AI", right? Yet now we have a clutch of new "definitions" all of which dilute and weaken the meaning.

> In Sweden for instance, CSAM is any image of an underage subject (real or realistic digital) designed to evoke a sexual response.

No corroboration found on web. Quite the contrary, in fact:

"Sweden does not have a legislative definition of child sexual abuse material (CSAM)"

https://rm.coe.int/factsheet-sweden-the-protection-of-childr...

> If you take a picture of a 14 year old girl (age of consent is 15) and use Grok to give her bikini, or make her topless, then you are most definately producing and possessing CSAM.

> No abuse of a real minor is needed.

Even the Google "AI" knows better than that. CSAM "is considered a record of a crime, emphasizing that its existence represents the abuse of a child."

Putting a bikini on a photo of a child may be distasteful abuse of a photo, but it is not abuse of a child - in any current law.

mortarion 4 hours ago | parent | next [-]

This is the actual law (Brottsbalken 16:10a)

https://www.riksdagen.se/sv/dokument-och-lagar/dokument/sven...

A person who

1. depicts a child in a pornographic image,

2. disseminates, transfers, provides, exhibits, or otherwise makes such an image of a child available to another person,

3. acquires or offers such an image of a child,

4. facilitates contacts between buyers and sellers of such images of children or takes any other similar measure intended to promote trade in such images, or

5. possesses such an image of a child or views such an image to which he or she has gained access

shall be sentenced for a child pornography offense to imprisonment for at most two years.

Then there's Proposition 2009/10:70, which is a clarifying document on how the law should be interpreted:

https://www.riksdagen.se/sv/dokument-och-lagar/dokument/prop...

Let me quote (translated):

"To depict a child in a pornographic image entails the production of such an image of a child. An image can be produced in various ways, e.g., by photographing, filming, or drawing a real child. Through various techniques, more or less artificial images can also be created. For criminal liability, it is not required that the image depicts a real child; images of fictitious children are also covered. New productions can also be created by reproducing or manipulating already existing depictions, for example, by editing film sequences together in a different order or by splicing an image of a child’s head onto an image of another child’s body."

mortarion 4 hours ago | parent | next [-]

Not only that. This law exists like this because of a EU directive.

https://eur-lex.europa.eu/eli/dir/2011/93/oj/eng

Let me quote again: Pay attention to c.iv specifically:

(c) ‘child pornography’ means:

(i) any material that visually depicts a child engaged in real or simulated sexually explicit conduct;

(ii) any depiction of the sexual organs of a child for primarily sexual purposes;

(iii) any material that visually depicts any person appearing to be a child engaged in real or simulated sexually explicit conduct or any depiction of the sexual organs of any person appearing to be a child, for primarily sexual purposes; or

(iv) realistic images of a child engaged in sexually explicit conduct or realistic images of the sexual organs of a child, for primarily sexual purposes;

chrisjj 2 hours ago | parent [-]

Thanks. I paid attention but still didn't see how:

realistic images of a child engaged in sexually explicit conduct or realistic images of the sexual organs of a child, for primarily sexual purposes;

covers the example in question:

If you take a picture of a 14 year old girl (age of consent is 15) and use Grok to give her bikini, or make her topless, then you are most definately producing and possessing CSAM.

How about you?

chrisjj 2 hours ago | parent | prev | next [-]

> a child pornography offense to imprisonment for at most two years.

That underlines the extreme difference w.r.t. CSAM, which can get you life, at least here in UK.

chrisjj 2 hours ago | parent | prev [-]

> This is the actual law (Brottsbalken 16:10a)

Thanks, but what "the" actual law? Your one doesn't contain the purported Swedish CSAM definition, or any for that matter. Nor does it even mention abuse.

lava_pidgeon a day ago | parent | prev | next [-]

" Strange that there was no disagreement before "AI", right? Yet now we have a clutch of new "definitions" all of which dilute and weaken the meaning. "

Are you from Sweden? Why do you think the definition was clear across the world and not changed "before AI"? Or is it some USDefaultism where Americans assume their definition was universal?

chrisjj a day ago | parent [-]

> Are you from Sweden?

No. I used this interweb thing to fetch that document from Sweden, saving me a 1000-mile walk.

> Why do you think the definition was clear across the world and not changed "before AI"?

I didn't say it was clear. I said there was no disagreement.

And I said that because I saw only agreement. CSAM == child sexual abuse material == a record of child sexual abuse.

lava_pidgeon a day ago | parent [-]

"No. I used this interweb thing to fetch that document from Sweden, saving me a 1000-mile walk."

So you cant speak Swedish, yet you think you grasped the Swedish law definition?

" I didn't say it was clear. I said there was no disagreement. "

Sorry, there are lots of different judical definitions about CSAM in different countries, each with different edge cases and how to handle them. I very doubt it, there is a disaggrement.

But my guess about your post is, that an American has to learn again there is a world outside of the US with different rules and different languages.

chrisjj a day ago | parent [-]

> So you cant speak Swedish, yet you think you grasped the Swedish law definition?

I guess you didn't read the doc. It is in English.

I too doubt there's material disagreement between judicial definitions. The dubious definitions I'm referring to are the non-judicial fabrications behind accusations such as the root of this subthread.

lava_pidgeon a day ago | parent [-]

" I too doubt there's material disagreement between judicial definitions. "

Sources? Sorry , your gut feeling does not matter. Esspecially if you are not a lawyer

chrisjj a day ago | parent [-]

I have no gut feeling here. I've seen no disagreeing judicial definitions of CSAM.

Feel free to share any you've seen.

rented_mule a day ago | parent | prev | next [-]

> Even the Google "AI" knows better than that. CSAM "is [...]"

Please don't use the "knowledge" of LLMs as evidence or support for anything. Generative models generate things that have some likelihood of being consistent with their input material, they don't "know" things.

Just last night, I did a Google search related to the cell tower recently constructed next to our local fire house. Above the search results, Gemini stated that the new tower is physically located on the Facebook page of the fire department.

Does this support the idea that "some physical cell towers are located on Facebook pages"? It does not. At best, it supports that the likelihood that the generated text is completely consistent with the model's input is less than 100% and/or that input to the model was factually incorrect.

chrisjj a day ago | parent [-]

Thanks. For a moment I slipped and fell for the "AI" con trick :)

fmbb a day ago | parent | prev | next [-]

> - in any current law.

It has been since at least 2012 here in Sweden. That case went to our highest court and they decided a manga drawing was CSAM (maybe you are hung up on this term though, it is obviously not the same in Swedish).

The holder was not convicted but that is besides the point about the material.

chrisjj a day ago | parent [-]

> It has been since at least 2012 here in Sweden. That case went to our highest court

This one?

"Swedish Supreme Court Exonerates Manga Translator Of Porn Charges"

https://bleedingcool.com/comics/swedish-supreme-court-exoner...

It has zero bearing on the "Putting a bikini on a photo of a child ... is not abuse of a child" you're challenging.

> and they decided a manga drawing was CSAM

No they did not. They decided "may be considered pornographic". A far lesser offence than CSAM.

direwolf20 3 hours ago | parent [-]

You are both arguing semantics. A pornographic image of a child. That's illegal no matter what it's called. I say killing, you say murder, same law though, still illegal.

chrisjj 2 hours ago | parent [-]

> I say killing, you say murder, same law though

Not in any European law I know. See suicide and manslaughter.

lawn a day ago | parent | prev | next [-]

In Swedish:

https://www.regeringen.se/contentassets/5f881006d4d346b199ca...

> Även en bild där ett barn t.ex. genom speciella kameraarrangemang framställs på ett sätt som är ägnat att vädja till sexualdriften, utan att det avbildade barnet kan sägas ha deltagit i ett sexuellt beteende vid avbildningen, kan omfattas av bestämmelsen.

Which translated means that the children does not have to be apart of sexual acts and indeed undressing a child using AI could be CSAM.

I say "could" because all laws are open to interpretation in Sweden and it depends on the specific image. But it's safe to say that many images produces by Grok are CSAM by Swedish standards.

chrisjj 2 hours ago | parent [-]

Thanks, but CSAM includes abuse, and the offence of your quote (via Google Translate) does not.

Your quote's offence looks like child porn. Max. 2 years jail. CSAM goes up to life, at least here in UK. Quite a difference.

> But it's safe to say that many images produces by Grok are CSAM by Swedish standards.

So the Govt/police would have acted against Grok, right? Have they?

freejazz 20 hours ago | parent | prev | next [-]

Where do these people come from???

drcongo a day ago | parent | prev | next [-]

The lady doth protest too much, methinks.

direwolf20 18 hours ago | parent [-]

That's the problem with CSAM arguments, though. If you disagree with the current law and think it should be loosened, you're a disgusting pedophile. But if you think it should be tightened, you're a saint looking out for the children's wellbeing. And so laws only go one way...

tokai a day ago | parent | prev [-]

"Sweden does not have a legislative definition of child sexual abuse material (CSAM)"

Because that is up to the courts to interpret. You cant use your common law experience to interpret the law in other countries.

chrisjj a day ago | parent [-]

> You cant use your common law experience to interpret the law in other countries.

That interpretation wasn't mine. It came from the Court of Europe doc I linked to. Feel free to let them know its wrong.

freejazz 20 hours ago | parent [-]

So aggressive and rude, and over... CSAM? Weird.

tokai 2 hours ago | parent [-]

chrisjj has some atrocious takes. But supporting CSAM is the worst he has done by far.

chrisjj 2 hours ago | parent [-]

I'm not supporting CSAM. I'm supporting the defence of the term CSAM from attempts at dilution and diminution which downplay the true severity of this appaling crime.

freejazz 20 minutes ago | parent [-]

You just seem incredibly argumentative and unreasonable and do not seem to care about "this appalling crime" at all.

worthless-trash a day ago | parent | prev | next [-]

As good as Australia's little boobie laws.

chrisjj a day ago | parent [-]

https://www.theregister.com/2010/01/28/australian_censors/

logicchains a day ago | parent | prev [-]

You don't see a huge difference between abusing a child (and recording it) vs drawing/creating an image of a child in a sexual situation? Do you believe they should have the same legal treatment? In Japan for instance the latter is legal.

ffsm8 a day ago | parent [-]

He made no judgement in his comment, he just observed the fact that the term csam - in at least the specified jurisdiction - applies to generated pictures of teenagers, wherever real people were subjected to harm or not.

I suspect none of us are lawyers with enough legal knowledge of the French law to know the specifics of this case

yafinder a day ago | parent [-]

This comment is a part of the chain that starts with a very judgemental comment and is an answer to a response challenging that starting one. You don't need legal knowledge of the French law to want to distinguish real child abuse from imaginary. One can give arguments why the latter is also bad, but this is not an automatic judgment, should not depend on the laws of a particular country and I, for one, am deeply shocked that some could think it's the same crime of the same severity.

moolcool a day ago | parent | prev | next [-]

Are you implying that it's not abuse to "undress" a child using AI?

You should realize that children have committed suicide before because AI deepfakes of themselves have been spread around schools. Just because these images are "fake" doesn't mean they're not abuse, and that there aren't real victims.

chrisjj a day ago | parent [-]

> Are you implying that it's not abuse to "undress" a child using AI?

Not at all. I am saying just it is not CSAM.

> You should realize that children have committed suicide before because AI deepfakes of themselves have been spread around schools.

Its terrible. And when "AI"s are found spreading deepfakes around schools, do let us know.

mrtksn 20 hours ago | parent | next [-]

CSAM: Child Sexual Abuse Material.

When you undress a child with AI, especially publicly on Twitter or privately through DM, that child is abused using the material the AI generated. Therefore CSAM.

chrisjj 13 hours ago | parent [-]

> When you undress a child with AI,

I guess you mean pasting a naked body on a photo of a child.

> especially publicly on Twitter or privately through DM, that child is abused using the material the AI generated.

In which country is that?

Here in UK, I've never heard of anyone jailed for doing that. Whereas many are for making actual child sexual abuse material.

enaaem 12 hours ago | parent | prev [-]

[flagged]

secretsatan a day ago | parent | prev [-]

It doesn't mention grok?

chrisjj a day ago | parent [-]

Sure does. Twice. E.g.

Musk's social media platform has recently been subject to intense scrutiny over sexualised images generated and edited on the site using its AI tool Grok.

mfru a day ago | parent [-]

CTRL-F "grok": 0/0 found

chrisjj a day ago | parent | next [-]

You're using an "AI" browser? :)

lawn a day ago | parent | prev [-]

I found 8 mentions.