Remix.run Logo
▲ betterunix2 an hour ago

The actual question to ask is if the agent makes more mistakes than a human being. Grading homework involves reading over similar/identical answers to the same questions over and over, and it is easy for human beings to make mistakes while doing that.

(That is basically the argument for OCR in the postal system -- it does make mistakes but it makes fewer mistakes than human beings.)