Remix.run Logo
sgirard 5 hours ago

This is interesting. I don't know how the AI agent guidelines will be enforced because there will always be a model outside the curriculum that a student can use to bypass the guidelines. Encouraging academic integrity is useful but requires the student to buy into the idea that they are paying for an education, not a diploma. This is a tough problem and I have been wondering how CS departments are incorporating AI into the curriculum while encouraging appropriate use in a learning environment.

j_french 2 hours ago | parent | next [-]

I think the answer to "how will AI agent guidelines be enforced" is that they won't be because they can't be, at least not directly.

This doesn't mean that this approach doesn't have value though. I think it very much does.

One way to indirectly enforce use of the AI agent guidelines is via an oral examination where the instructor and student look over their work together and talk about it. Students who have genuinely tried to learn and used AI as a learning tool via the agent guidelines should do a lot better in an oral exam than students who have used AI as a solution generator.

I adopted the oral exam (without agent guidelines) for a course i teach in the academic year just gone, it worked pretty well. Next term I intend to include the agent guidelines to give them clearer guardrails. Still ultimately optional, but if students choose to ignore them it's gonna be pretty obvious during our conversation.

earthnail 4 hours ago | parent | prev | next [-]

Stanford has an honour code. Meant no oversight even during exams. Worked surprisingly well when I was there. The flipside is, if you’re ever caught cheating, there are no second chances.

I imagine this applies here, too, if they want to enforce it strictly.

asdff 4 hours ago | parent | next [-]

>Worked surprisingly well when I was there.

How could you tell? I proctored. People cheat pretty frequently and other students are none the wiser. It really takes like 4 proctors if you want to do it right. Even then I'm sure the clever ones are slipping through. These were scantron though. Short response/essay format you'd be screwed if you didn't know your stuff.

henry2023 4 hours ago | parent | prev | next [-]

Marc Tessier-Lavigne was Stanford's president from 2016 to 2023. Not sure if the honor code means anything nowadays.

shimman 4 hours ago | parent | prev [-]

You mean it worked well for cheaters right? The more I learn about these "honor codes" the more I realize how sheltered these American elites have become.

earthnail an hour ago | parent [-]

No, I mean it generally worked well. I can't really say how it worked in undergrad because grad and undergrad school were so separate. I can only talk about grad school. I was really surprised myself how well it worked because I didn't know this coming from my university in Germany, but it really did work, at least in every exam I saw. And I don't consider myself overly naive. I guess it has to do with the fact that people who get admitted to Stanford grad school have already proven a certain work ethic and really want to do the exams to learn more. Your final grade isn't as important when you graduate from Stanford; it only really matters if you want to do a PhD, otherwise it's borderline irrelevant. "I went to Stanford" is all you need for your CV. So I didn't feel a lot of pressure being there of always having to have the best grades, it was more about using your very expensive time there wisely to learn as much as you can, and I felt my peers were the same.

Now, I'm not saying every place can be like that, I'm just trying to explain why at this particular university, the honor code is a reasonable policy that may work perfectly well on policing AI in exams. You can't copy that to other institutions, but it answers how they do it here.

itopaloglu83 4 hours ago | parent | prev | next [-]

Well, no amount of instructions would work if the student has no intention to learn anything.

gchamonlive 4 hours ago | parent | prev | next [-]

In an ideal world guidelines should be suggestions for those willing to make the best of the course and improve as a person and professional. However a degree has real world value and repercussions, so enabling someone incompetent to do a dangerous job can put innocent lives in jeopardy. It's tough, but I hope in time we learn how to live with this new tech.

4 hours ago | parent | prev [-]
[deleted]