Sure they are, but do you think they are continuing training to improve a model after release without bumping the version number, presumably only to game the benchmarks?

If you're willing to cheat, isn't it just a matter of grepping for the benchmark's question and pasting the solution in the chain of thought?