Remix.run Logo
cm2012 11 hours ago

At-home testing is dead.

raddan 10 hours ago | parent | next [-]

It is. I think the professor here was being naive, but I appreciate his optimism. When I was in college (in the 90s), take home exams allowed a knowledgeable student to really shine. I’m not saying that they weren’t eminently cheatable back then—they were—but they also had the odd side-effect that, if it was a class you cared about, the test itself could be a learning experience.

For context, I am also a faculty member at a highly selective college. I had a similar shocking realization last year that it was likely that there was widespread cheating on homework assignments, which I used to favor heavily toward their grades. To verify my suspicions, I generated custom tests for every student in the class: the exam included code from students’ own programming assignment submissions. All I asked them to do was explain what they wrote.

The class performed badly on this exam, and the results were strongly bimodal. Roughly half the class aced the exam. The other half could make neither heads nor tails out of the code. For the students who wrote things like “lol, i have no idea” (real response) I opened honor cases.

I think many faculty right now are going through the stages of grief. We all knew that even at selective institutions, cheating existed, that many students were in it for the credentials. But as long as the numbers of known cases was low, we could convince ourselves that the few doing it were outliers. When a class does it en masse, it’s more than a slap in the face; it makes you feel like a chump. Have we been fooling ourselves this entire time? Was all the time I spent becoming a subject-matter expert a waste? Are the students just rolling their eyes when I turn my back? Those thoughts hurt. I personally chose to become a faculty member because it seemed like research and teaching were the best ways to maximize my impact.

I still have some hope. After all, I still spend my days working and socializing with like-minded thinkers, some of whom are truly brilliant. And every year, a handful of students come out of the woodwork and surprise me. But it’s hard not to think that the group of people who find joy in learning and creating is shrinking.

silver_silver 10 hours ago | parent | next [-]

My experience as a student has always been that most of the class will cheat given the chance. I remember in high school being one of maybe a dozen in a grade of over 200 who actually read the assigned novels. Everyone else used cliff/spark notes not just to familiarise themselves but also to plagiarise essays.

cm2012 10 hours ago | parent | prev | next [-]

For most people, college is a box to check off. And individual classes are even more so.

Drupon 10 hours ago | parent | next [-]

The majority of people with this mindset should not go to college and should just get a trade job or manufacturing job like they did 100 years ago. People were like this a few decades ago as well when I got my degree. I didn't have consistently great classmates until honors and accelerated grad courses in my 3rd and 4th year, along with various domain specific student orgs like groups for hardware hacking, computer security, etc.

Obviously this can't happen without some structural change (virtually impossible in the US due to its political ossification and indefinite deadlock) because a degree is now just a way of gatekeeping the middle class, but dull and incurious minds made ideal manual laborers in the past, and, at some point, we lost sight of that and started rotting our corporate world out with them.

rbanffy 2 hours ago | parent | next [-]

> The majority of people with this mindset should not go to college and should just get a trade job or manufacturing job like they did 100 years ago

As long as this allows them to provide for themselves and their families, buying homes, and retiring the same way as someone who goes to college.

Going to college should not be something people do to escape abject poverty, but something you want to do to enrich your life and make yourself a better person.

versteegen 9 hours ago | parent | prev [-]

> The majority of people with this mindset should not go to college

Seems obvious now that this is the solution. Unfortunately, universities would never agree to downsize, not due to politics or any US-specific problems.

danpalmer 10 hours ago | parent | prev [-]

College is a box to check off because we have lost the ability to support a workforce without college degrees (at least in the US, UK, AU, where I have some experience).

Trades are critical but looked down on. Manufacturing is gone (which isn't in itself a bad thing). The service industry doesn't pay a living wage (thankfully it's reasonable here in AU). Apprenticeships don't pay enough. And pretty much all knowledge work jobs expect a degree from the beginning at a junior level.

We should be planning for a system where <20% of people go to university, instead of expecting >60% to go. Robust minimum wages, good trade schools, apprenticeships that pay enough for a wide range of roles, and changing the culture to not look down on folks that take these paths.

phist_mcgee 10 hours ago | parent [-]

Sounds like you're in AU, I will point out that trades are not looked down on at all in this country. In fact culturally we value chippies and sparkies higher than desk jockeys.

danpalmer 8 hours ago | parent | next [-]

Yeah this was a generalisation across the US/UK/AU. I come from the UK but now live in AU, and know the US a bit.

I think the looking down on trades is not quite as simple as I summarised it as, and I think AU does a lot better at all of the above than the US/UK, but I still see aspects of it. Tradies make good money in all 3 countries due to lack of supply, and yet there are still stereotypes of jobs like lawyers, doctors, (software engineers?) being better in some way.

It's a nuanced problem, but I don't get the impression that trades here are culturally valued higher than a lot of "white collar" work. Compared to ambiguous "desk jockeys" yes, but that's due to negative stereotypes about bullshit jobs, if you actually named a specific job I think you'd find different attitudes. Lawyers, accountants, sales/marketing, various engineering disciplines, IT, I think these are widely considered "better" jobs than trades, even though in most ways that's far from true.

raddan 8 hours ago | parent | prev [-]

As a non-Australian I just have to know what “chippies” and “sparkies” are!

perilunar 8 hours ago | parent [-]

Chippy = carpenter (from wood chips)

Sparky = electrician

b112 10 hours ago | parent | prev [-]

But it’s hard not to think that the group of people who find joy in learning and creating is shrinking.

I'm not sure you should think it is shrinking. There are a lot of people in this world that hate to learn, and literally are incredibly apathetic about any topic. To such, learning anything is work, never a joy.

Before AI they had to learn to succeed. Now they see a shortcut. You said half showed they were learning, that's not so bad. I think you should be glad it's that high. I am.

Cider9986 11 hours ago | parent | prev | next [-]

That would be good.

https://www.baneproctoring.com/

martythemaniak 10 hours ago | parent [-]

I clicked expecting Bane Proctoring, where Bane monitors your exam and if he catches you cheating...

jimmygrapes 10 hours ago | parent [-]

it would be extremely painful

... I'm sorry I couldn't help it

drdaeman 11 hours ago | parent | prev | next [-]

Just wait a few decades until brain-machine interfaces will become a mass-market thing.

noosphr 11 hours ago | parent [-]

Can't wait for the EU brain control bill.

We support our citizens right to free will so long as they don't think anything bad.

drdaeman 10 hours ago | parent [-]

You jest, but I’m pretty sure it’ll be a thing somewhere, it’ll take its toll, and eventually fail from its own flaws. Then, chances are, there will be some lessons learnt - although, most likely, not on the first try. But that’s just a futuristic speculation.

My point was, however, that in modern age, where we’re literally on the verge of redefining humanity, we might be forced to redefine “cheating” as well. It’s all surely starting to slowly crack at the seams for the last half a century, and the pace is only increasing. When I was a kid, electronic calculators were banned (but not the slide rule, heh), nowadays, I’ve heard, even programmable ones are becoming accepted.

therealdrag0 10 hours ago | parent | prev | next [-]

How is this even a debate? Before Covid most tests were in person right? Sure some classes had final projects that were take home, but in person tests were very norma. So what’s all the hand wringing about? Just do in person tests and move on?

protocolture 10 hours ago | parent | prev [-]

Have you never had a home proctored test before?

You cant even sneak paper on to your desk, where do you plan to hide the LLM?

cosmic_cheese 10 hours ago | parent | next [-]

Yeah, I’m enrolled in an online degree program and use of AI in exams would be quite difficult.

The proctoring service my school uses requires a special browser with admin permissions and an external webcam with your entire workspace, screen, and face clearly visible (wide angle webcam preferred). Prior to the exam you have to photograph the entirety of your room, and if there’s even an open door that can disqualify you. Only one screen is allowed and smartphones and smart watches are banned. A proctor is watching you and you’re being recorded the whole time. I have no idea how one could slip something like AI use past all this.

protocolture 10 hours ago | parent [-]

Thats my experience + they are listening the whole time. A loud noise from another room disqualified a coworker of mine.

piloto_ciego 9 hours ago | parent [-]

Hell, I got flagged for possible cheating in an online proctored test because I had a whiteboard behind me that had unrelated equations on it or some nonsense. I didn't even look at them lol.

The instructor reviewed the footage, laughed, and said, "wow, what a pain in the butt to deal with" and cancelled the alert or whatever. Almost all the classes I've taken online have been way harder for potential cheating than in person classes.

I'll say this too, I took a course called something like "applied mathematical methods" online a long time ago. That class's final basically said, "use whatever resources you want except for other people" - ChatGPT would have probably made short work of the exam, but at the time, even with the power of the internet about 10 years ago, there's no way I could have used it to help me. I doubt even teaming up would have helped that much to be honest lol.

I had 24 hours to do the test and it was pretty hard to get done in that time. I think it took me something like 5 or 6 hours to do it? Making your tests muderously difficult is one way to handle the temptation to cheat in online courses. I don't know that that's the best solution from a pedagogy standpoint, but hey, I'm not a prof.

drdaeman 10 hours ago | parent | prev [-]

Have you heard the story of Hans Niemann? ;-)

(True or not, a story is a story.)