> If you take "reliably" to mean "1 in 200 false positive rate" as they disclose on their front page

Pangram claims a 1 in 10,000 false positive rate (rate at which human-authored texts are incorrectly classified as AI-generated). 1 in 200 sounds like the false negative rate (rate at which AI-generated texts are classified as human-authored), or perhaps a rate for a specific category of text.

Good point of precision, I read their site too quickly. I don't think my argument materially changes with that number instead however. There were over 40,000 students enrolled in my university alone. Generously assuming they only turn in one assignment per year, having 4 of them go through the "computer says you cheated, and as you can see, it's 99.9% accurate" gauntlet is not a price we should be willing to pay for... the marginal benefit of this tool over more classical ways to proctor and assess pupils