Remix.run Logo
▲ kouteiheika 2 hours ago

Fun, but considering this puts `claude-sonnet-5` at the first place isn't it a little... iffy when it comes to measuring intelligence?

▲hp6 2 hours ago | parent [-]

I was also surprised by this, from a proper benchmarks perspective your right, this is iffy. To make it a legit I would have to increase the number of games significantly as well as understand how much of it is random and how much real signal, not to say make the game more complex.

But all of it would kill the fun)