| ▲ | bennettnate5 2 hours ago | ||||||||||||||||
The computer security research community is strongly against using AI detectors, in part because the evidence has come against their being at all useful at scale [1]. Far too many false positives and negatives that the whole thing effectively becomes a witch-hunt test. [1] https://ieeexplore.ieee.org/stampPDF/getPDF.jsp?tp=&arnumber... | |||||||||||||||||
| ▲ | bheadmaster an hour ago | parent | next [-] | ||||||||||||||||
South Park perfectly depicted the nature AI detectors: | |||||||||||||||||
| ▲ | azan_ an hour ago | parent | prev | next [-] | ||||||||||||||||
> Our evaluation not only finds that performance varies wildly across AIGT detectors (e.g., FPRs between 0.05 % and 68.6 % and FNRs ranging between 0.3 % and 99.6 %). So it appears that there are good detectors that can be used and bad ones that shouldn’t. | |||||||||||||||||
| |||||||||||||||||
| ▲ | OneManyNone 39 minutes ago | parent | prev | next [-] | ||||||||||||||||
I cannot read the entirety of this article, but nowhere in the abstract does it mention Pangram, which has repeatedly been shown in many independent studies to have a false positive rate of less than 1 in 10,000; by some accounts it is now down to 1 in 20,000. Obviously there are many bad detectors that shouldn't be used, but it's so bizarre when studies like this leave out extremely high-quality detectors. For some reason there's just a segment of people who are dead-set on letting the world get polluted with bad writing. | |||||||||||||||||
| ▲ | tmpz22 an hour ago | parent | prev [-] | ||||||||||||||||
Why do we invest 100s of Billions in the belief AGI is possible, yet an AI detector which protects the integretity of critical research is beyond our grasp? Quitter. | |||||||||||||||||
| |||||||||||||||||