Remix.run Logo
pegasus a day ago

That difference is not essential to the question at hand. An open book test based on an erroneous book would give the same results as this test, even if it wouldn't penalize blank answers.

what a day ago | parent [-]

An open book test would only be given where the book is the reference material and would be considered correct? It’s more like saying you can google the answers and you blindly trust the SEO slop in the first result.

Dylan16807 a day ago | parent [-]

> An open book test would only be given where the book is the reference material and would be considered correct?

If you're saying they wouldn't suggest a book with considered-wrong answers in a real test, then they wouldn't suggest an LLM they know gives lots of wrong answers either.