Have you ever used an open model for a bit? I am not saying they are not benchmaxxing but they really do work well and are only getting better.

I have used a lot of them. They’re impressive for open weights, but the benchmaxxing becomes obvious. They don’t compare to the frontier models (yet) even when the benchmarks show them coming close.