Remix.run Logo
▲ patrickmay 2 hours ago

Abstract, for those not interested in reading TFA:

"Large language models now write papers and referee reports in economics. The field must develop best practices for handling AI-generated text in the publication process. Otherwise, peer review is in serious danger of collapsing. We propose that AI detectors should become a standard tool of the profession. Our experiment shows that they flag referee reports written by AI, not reports that AI merely proofread or helped edit.

Aided by a simple model, we argue that a paper flagged as AI-generated should trigger a closer reading and can be rejected at the first mistake, and that an AI-generated referee report adds nothing that editors could not get by running the prompt themselves. Such reports are unacceptable: they damage authors and journals and should be treated like plagiarism. Individual restraint has already shown its limits, and the profession needs to develop norms to solve this collective action problem. We close with a practical guide for authors, referees, and editors."

▲bennettnate5 2 hours ago | parent | next [-]

The computer security research community is strongly against using AI detectors, in part because the evidence has come against their being at all useful at scale [1]. Far too many false positives and negatives that the whole thing effectively becomes a witch-hunt test.

[1] https://ieeexplore.ieee.org/stampPDF/getPDF.jsp?tp=&arnumber...

▲bheadmaster an hour ago | parent | next [-]

South Park perfectly depicted the nature AI detectors:

https://youtu.be/kVzUGRaWVT4

▲azan_ an hour ago | parent | prev | next [-]

> Our evaluation not only finds that performance varies wildly across AIGT detectors (e.g., FPRs between 0.05 % and 68.6 % and FNRs ranging between 0.3 % and 99.6 %).

So it appears that there are good detectors that can be used and bad ones that shouldn’t.

▲Borealid an hour ago | parent [-]

That set of statistics does not tell you whether there are good detectors or not.

If the low FPR and the low FNR are the same detector, that's good. But it's more likely one detector has a high FNR and a different detector a high FPR, and the texts causing errors may be correlated across detectors making a "best of both worlds" multipass approach difficult or impossible.

▲azan_ 11 minutes ago | parent [-]

Low fpr with avg fnr is still very useful.

▲OneManyNone 37 minutes ago | parent | prev | next [-]

I cannot read the entirety of this article, but nowhere in the abstract does it mention Pangram, which has repeatedly been shown in many independent studies to have a false positive rate of less than 1 in 10,000; by some accounts it is now down to 1 in 20,000.

Obviously there are many bad detectors that shouldn't be used, but it's so bizarre when studies like this leave out extremely high-quality detectors. For some reason there's just a segment of people who are dead-set on letting the world get polluted with bad writing.

▲tmpz22 an hour ago | parent | prev [-]

Why do we invest 100s of Billions in the belief AGI is possible, yet an AI detector which protects the integretity of critical research is beyond our grasp?

Quitter.

▲dale_glass 43 minutes ago | parent [-]

Because it's an impossible problem. AI generates just words, and both AI and people use the same words. In fact both learn from each other. AI learns from people and eventually people will pick up patterns from AI.

Also, in many cases, a false positive hurts the innocent more than the cheaters. Many cheaters are already taking failure into account, while those innocent do not.

▲itomato 2 hours ago | parent | prev | next [-]

The more I get serious about this, the more I want to see Machines produce Machine-native output. I don't want crossover or doubt. I want high confidence that machine output:

- is optimized for machine input

- is convertible to human-native symbols, context

- includes metadata and proof-of-custody/origin

- leans into its role as an evolving language

- is necessarily terse and token-efficient

▲ramses0 2 hours ago | parent [-]

Basically: `unzaip output.zaip.gpg.sig --lang=EN-us --include-prompt`

`zip` => `zAIp`

It gets around some of my general complaints about "checking generated artifacts into version control", really interesting idea!

▲p-e-w 2 hours ago | parent | prev | next [-]

> Aided by a simple model, we argue that a paper flagged as AI-generated should trigger a closer reading and can be rejected at the first mistake

“We propose a witch hunt fueled by unreliable, unaccountable, proprietary detection technology that’s roughly equivalent to tea leaf reading and can be fooled by trivial rewrite templates that anyone can find with a 5-second web search.”

▲pwndByDeath 2 hours ago | parent [-]

I found it more ironic that in order to save a burdened system we'll add a step that demands a heavier burden to the system.

▲javier123454321 2 hours ago | parent [-]

Just throw more compute at it is the answer for everything for the AI pilled.

▲mistermann 2 hours ago | parent | prev [-]

[dead]