There is too many money involved, benchmark can’t be trusted.

I had a favorite benchmark, SWE-rebench, but sadly it's no longer maintained.

But yeah, I'll just take these benchmarks with a grain of salt. Only hands-on experience matters in the end, and these days it's very easy to switch models.