Remix.run Logo
d2p an hour ago

I clicked through and it showed Qwen at the top at 55.4 compared to 55.3 for Opus Max. I have a screenshot.

Then I clicked away and back, and now it goes Qwen second, with 58.4, to Opus Max at top with 59.2.

I have screenshots of both. The description above the chart is the same in boh cases:

> Artificial Analysis Agentic Index > Represents the weighted average of agentic capabilities benchmarks in the Artificial Analysis Intelligence Index (GDPval-AA v2, ³-Banking)

What happened? How can the scores change so much in a few seconds?

h14h an hour ago | parent | next [-]

They JUST updated their methodology:

https://artificialanalysis.ai/methodology/intelligence-bench...

ahartmetz 35 minutes ago | parent [-]

Fixed the result, eh? In both senses of the word.

apitman 30 minutes ago | parent | prev | next [-]

Welp. That didn't last long

WD-42 an hour ago | parent | prev [-]

Same, they just updated it. Hacker news effect?