Remix.run Logo
bsoqk 2 days ago

>the Tech Transparency Project (TTP) reported that Meta failed to detect 332 ads containing CSAM this year

Considering the amount of ads they handle that seems... reasonable?

Not to mention the stupidity of calling the result of nudify apps "CSAM" when no minors in situation of sexual abuse are used in any way to generate those photos.

steve_adams_86 2 days ago | parent | next [-]

> Considering the amount of ads they handle that seems... reasonable?

Why reasonable? Don't these ads pass through pre-publication review, and Meta makes money off of it? Any number above zero is a serious problem. If they can't run an ad business that doesn't publish and profit off of CSAM, they shouldn't run it.

I don't think we should distinguish between 'fake' and real CSAM based on if kids are hurt; this ad machine shouldn't be able to publish it, regardless. The moral question of if it's real or kids were directly harmed seems separate to me.

washadjeffmad 2 days ago | parent | next [-]

I recall YouTube was hijacked to show multi-hour ads during the pandemic. These are imperfect systems that can be abused at any scale.

They identified them after the fact and appear to have disclosed that. This is what they needed to do to be able to be held accountable and to do better detecting them in the future.

I block ads and ad services at the device and network level and don't use any Meta services (outside of facebookresearch models), so while I'm fortunate not to have been able to be served any of these, it's also kind of unfortunate that I'm in a relatively rare category to know to report them and how.

treesknees a day ago | parent | prev | next [-]

Without more context it’s hard to say whether 332 is reasonable, but I interpreted “reasonable” as in there will always be some amount of harmful content uncaught by automated systems.

steve_adams_86 20 hours ago | parent [-]

I agree, more context would be helpful.

In my mind there are two components of this that are in direct tension though, regardless of numbers:

1. Humans having to review ad content is legitimately traumatizing and awful

2. Automated systems can miss obviously harmful content, which should never be allowed

To me this means we probably shouldn't permit these systems to scale as they do, because the company profits from harms to its own workers and/or ad viewers. I worry that we've normalized a business that shouldn't exist in its current form, but it prints so much cash that no one is willing to stop it.

2OEH8eoCRo0 2 days ago | parent | prev [-]

I'm tired of the argument that since it would be impossible to police at scale then they shouldn't be liable.

Just accept money for CSAM ads without accountability, it's fine. No ethical issue here. Why is everyone so angry? /s

publlus_enigma 2 days ago | parent | prev | next [-]

How many ads for CSAM do your local TV networks broadcast? How many billboards do you drive past featuring CSAM? How about newspapers?

If a company can't operate within the law due to the scale it chooses to operate at, then it should choose not to operate at that scale.

It doesn't become acceptable to break the law because your scale means there a lots of times you don't break the law either.

a day ago | parent [-]
[deleted]
SiempreViernes 2 days ago | parent | prev | next [-]

> The young royal’s image was “animated into a video of her performing a graphic sex act,” TTP found. Other ads animated a photo of a 14-year-old Instagram influencer “showing off her new sports club uniform” into “a video of her performing oral sex.” A third “preteen” victim “posing in a pink athletic outfit with pigtails” in a series of stock photos was morphed into a video where she looks frightened as she’s molested by an adult male, TTP reported.

bsoqk 2 days ago | parent [-]

[flagged]

washadjeffmad 2 days ago | parent | prev | next [-]

This is one of those topics that gets radioactive quickly, so I'm trying to parse this comment under the recent ruling by a judge that certain obscene products of generative AI are protected under the First Amendment.

"We now live in an age where GenAI [generative AI] models can render images depicting the abuse of virtual children that are virtually indistinguishable from those depicting the abuse of actual children. This case illuminates how this evolving technology complicates the lines drawn by the Supreme Court in Stanley, Osborne, and Free Speech Coalition. Indeed, in Free Speech Coalition, the Supreme Court addressed the scope of First Amendment protections for virtual CSAM, but that was nearly twenty-five years ago, and the image-generation technology available today was likely unimaginable back then. Given the relentless advancement in artificial intelligence models, we have some concerns about the lines these cases draw, but we are not free to redraw them ourselves."

https://www.snopes.com/fact-check/judge-ai-child-sex-abuse-r...

Despite the source images not being CSAM, the products of nudify services may be CSAM but not child pornography. Because nudifying minors involves generation of material intended to depict real people who cannot give consent on computers outside the home, I'd consider them not to be protected speech.

2 days ago | parent [-]
[deleted]
bigfatkitten a day ago | parent | prev [-]

> Considering the amount of ads they handle that seems... reasonable?

Every time they disseminate one of these ads, they commit a serious criminal offence. What threshold of criminality is reasonable to you?