Remix.run Logo
catoc 2 hours ago

With how they’re currently being used we might as well call them bendmarks.

Every newly released model is paraded as SOTA showing peak or near peak performance on cherry-picked bendmarks the model was either fine-tuned on, or tested under specific conditions optimal for that model.