Remix.run Logo
▲ bennettnate5 2 hours ago

The computer security research community is strongly against using AI detectors, in part because the evidence has come against their being at all useful at scale [1]. Far too many false positives and negatives that the whole thing effectively becomes a witch-hunt test.

[1] https://ieeexplore.ieee.org/stampPDF/getPDF.jsp?tp=&arnumber...

▲bheadmaster an hour ago | parent | next [-]

South Park perfectly depicted the nature AI detectors:

https://youtu.be/kVzUGRaWVT4

▲azan_ an hour ago | parent | prev | next [-]

> Our evaluation not only finds that performance varies wildly across AIGT detectors (e.g., FPRs between 0.05 % and 68.6 % and FNRs ranging between 0.3 % and 99.6 %).

So it appears that there are good detectors that can be used and bad ones that shouldn’t.

▲Borealid an hour ago | parent [-]

That set of statistics does not tell you whether there are good detectors or not.

If the low FPR and the low FNR are the same detector, that's good. But it's more likely one detector has a high FNR and a different detector a high FPR, and the texts causing errors may be correlated across detectors making a "best of both worlds" multipass approach difficult or impossible.

▲azan_ 13 minutes ago | parent [-]

Low fpr with avg fnr is still very useful.

▲OneManyNone 39 minutes ago | parent | prev | next [-]

I cannot read the entirety of this article, but nowhere in the abstract does it mention Pangram, which has repeatedly been shown in many independent studies to have a false positive rate of less than 1 in 10,000; by some accounts it is now down to 1 in 20,000.

Obviously there are many bad detectors that shouldn't be used, but it's so bizarre when studies like this leave out extremely high-quality detectors. For some reason there's just a segment of people who are dead-set on letting the world get polluted with bad writing.

▲tmpz22 an hour ago | parent | prev [-]

Why do we invest 100s of Billions in the belief AGI is possible, yet an AI detector which protects the integretity of critical research is beyond our grasp?

Quitter.

▲dale_glass an hour ago | parent [-]

Because it's an impossible problem. AI generates just words, and both AI and people use the same words. In fact both learn from each other. AI learns from people and eventually people will pick up patterns from AI.

Also, in many cases, a false positive hurts the innocent more than the cheaters. Many cheaters are already taking failure into account, while those innocent do not.