| ▲ | d2p an hour ago | |||||||
I clicked through and it showed Qwen at the top at 55.4 compared to 55.3 for Opus Max. I have a screenshot. Then I clicked away and back, and now it goes Qwen second, with 58.4, to Opus Max at top with 59.2. I have screenshots of both. The description above the chart is the same in boh cases: > Artificial Analysis Agentic Index > Represents the weighted average of agentic capabilities benchmarks in the Artificial Analysis Intelligence Index (GDPval-AA v2, ³-Banking) What happened? How can the scores change so much in a few seconds? | ||||||||
| ▲ | h14h an hour ago | parent | next [-] | |||||||
They JUST updated their methodology: https://artificialanalysis.ai/methodology/intelligence-bench... | ||||||||
| ||||||||
| ▲ | apitman 30 minutes ago | parent | prev | next [-] | |||||||
Welp. That didn't last long | ||||||||
| ▲ | WD-42 an hour ago | parent | prev [-] | |||||||
Same, they just updated it. Hacker news effect? | ||||||||