Remix.run Logo
seizethecheese an hour ago

Kimi doesn't do well on my "ask a trivia question that other AIs get wrong" test.

The question it came up with, "which U.S. state is closest to Africa?" is a pretty standard trivia question without any reason to believe other AIs would get confused. https://pellmell.ai/s/dccdeca69f929f79bc89317035610049

Even GPT-OSS-120b gets this right: https://pellmell.ai/s/1a43dfc7a3baa214aa0fa1b95d2c536a

anigbrowl an hour ago | parent [-]

Are you giving it your API for these other AIs to evaluate their responses? This 'test' seems perverse.

seizethecheese an hour ago | parent [-]

I don't understand the question.

The other AIs don't see the question until they are asked to react.