> The perverse incentives around benchmarks

I am not sure. The people who actually care enough to look at benchmarks will run evals, and find out quickly. If you post silly benchmark scores too often, you will simply be ignored. You are paying with your reputation.

Those consequences never stopped blog spam previously. Won’t stop it now lol

All the benchmarks are silly but people still want a quick way to put a new release in context