| ▲ | an0malous an hour ago | |
Actually I can answer my own question: we know that they have had previous access to the tests because they’ve run older models against the same benchmark. I wouldn’t put it past a company like OpenAI with a long history of lying and being deceptive to record the tests and benchmaxx ARC. They have trillions of dollars of incentive to cheat any way they can. | ||