Remix.run Logo
jrflowers 2 days ago

>It's funny because, in a pinch, ChatGPT will answer essentially every Jeopardy! clue correctly every single time now

“Answering Jeopardy questions” is one of those tasks where being close to correct is not good enough. A system that hallucinates plausible-sounding answers would be a kind of awful approach to creating software that’s meant to 100% a game like Jeopardy

AstralStorm 2 days ago | parent | next [-]

But a system with a perfect memory and sufficient search space would be great at it. This is precisely where the stochastic database, even a huge Markov model would work great.

Only the hard wordplays maybe would pose a problem, and statistically you can only go so hard on these before human players start lagging too.

Remembering a ton of facts is something the computer would be excellent at...

disillusioned 2 days ago | parent | prev [-]

I mean, it's not "close to correct". It's... really almost 100% correct.

Go try it. Hit up J-Archive, prompt it that you'll feed it Jeopardy answers and want a simple response in the form of a question. I've yet to stump it, even with stuff like Rhyme Time: "a racket-&-net sport peril" (tennis menace) or other more complex clues. Every once in awhile, it'll switch to the thinking model, but most were immediate and correct.

Try here: https://j-archive.com/showgame.php?game_id=8967

ZiiS 2 days ago | parent [-]

Tbf it almost certainly included this whole site in the training data.