Remix.run Logo
jjmarr a day ago

> Obviously with immense funding at stakes, companies have every incentive to game the benchmarks, and the loss of goodwill from gaming the system doesn't appear to have much consequences.

Claude 3.7 Sonnet was consistently on top of OpenRouter in actual usage despite not gaming benchmarks.