new | show | ask | jobs Github

snarky-comments 2 hours ago

Or how many are normally caught cheating?

Did they use AI to detect AI using cheaters?

▲

Manuel_D 37 minutes ago | parent | next [-]

When I was a section leader (not at Berkeley, though) we used MOSS: https://theory.stanford.edu/~aiken/moss/

It's not AI, its a deterministic program that analyzes compiled code for similarity.

▲

jmalicki 2 hours ago | parent | prev [-]

And if cheating was triggered using AI detectors, was it real?

AI detectors are pretty mid in practice - they tend to have a lot of false positives for "B" students who are okay, but can still be struggled to be more coherent than AIs are. There are some specific triggers that AIs are way more likely to do than students, but a lot of AI detectors will trigger on this "almost there, but you're still struggling" level of essay writing that might get a B, B-.

I could expect the same might be true for CS students even though I haven't seen how AI detectors work for CS/math homework.

	▲	acbart 14 minutes ago \| parent [-]
		You'd be amazed at how many students we know are obviously cheating because the logs reveal that they copy pasted a long, complete answer within seconds of opening a problem for the first time, full of sophisticated code constructs that we didn't teach them, and lot's of nicely formatted comments. Sometimes they even copy/paste the entire GPT output and then format it down.