Remix.run Logo
▲ aleqs 27 minutes ago

None of these benchmarks/marketing numbers from openai or anthropic have ever held up.

Now that we know anthropic nerfs models after release, and without any notice/openess, there is no reason to even think these benchmarks they release are even done with the same model/intelligence that actual customers would get.