| ▲ | augment_me 5 hours ago | |||||||
Do you have an alternative? Its a benchmark collection. When a benchmark gets saturated, they remove it from the index and add new ones. I think lm-arena is a better concept that reflects the actual target users, but it only captures chat, and relies on users spending their time improving it. | ||||||||
| ▲ | genneth 4 hours ago | parent [-] | |||||||
https://epoch.ai/eci?view=graph&tab=release-date is at least an alternative. They are slower to update, but entirely anecdotally I find the numbers are aligned with my personal observations a bit better than AA. But I am also highly aware this is some pretty confirmation-bias heavy ares of meta-benchmark picking... | ||||||||
| ||||||||