| ▲ | azan_ an hour ago | |||||||
> Our evaluation not only finds that performance varies wildly across AIGT detectors (e.g., FPRs between 0.05 % and 68.6 % and FNRs ranging between 0.3 % and 99.6 %). So it appears that there are good detectors that can be used and bad ones that shouldn’t. | ||||||||
| ▲ | Borealid an hour ago | parent [-] | |||||||
That set of statistics does not tell you whether there are good detectors or not. If the low FPR and the low FNR are the same detector, that's good. But it's more likely one detector has a high FNR and a different detector a high FPR, and the texts causing errors may be correlated across detectors making a "best of both worlds" multipass approach difficult or impossible. | ||||||||
| ||||||||