| ▲ | rico735 an hour ago | |
Out of interest, do you run the same tests more than once to generate that? What I often observe is that models being asked the exact same prompt can alternate between getting something right and getting it wrong, thanks to the wonders of a non-deterministic output. | ||