Remix.run Logo
▲ rico735 an hour ago

Out of interest, do you run the same tests more than once to generate that?

What I often observe is that models being asked the exact same prompt can alternate between getting something right and getting it wrong, thanks to the wonders of a non-deterministic output.