| ▲ | augment_me 28 minutes ago | |
Artificial Analysis is a VC-backed firm and it's unclear what the incentives are there. They have altered their benchmark multiple times in the last 4 weeks (v5 in https://artificialanalysis.ai/articles/artificial-analysis-i...) and the last 5.0.1 change https://artificialanalysis.ai/methodology/intelligence-bench... pushed up Anthropic's models a bit, you can see that v5.0.0 set on the first link Opus 5.5 has a lower score than in v5.0.1, and v5.0.1 was released just before Fable dropped. Some part of me believes that the benchmark mix was put together to favor Anthropic's models. | ||