Remix.run Logo
aesthesia 6 hours ago

Scoring for ARC-AGI-3 is constructed so that the median(-ish) human score is 100%, so this is not a superhuman result. However, the scaling is weird, since it's built from terms that look like (AI turns taken / median human turns) ^ 2, and it weights later levels higher than early levels. So it's not at all clear that 100% is twice as good as 50%.

aesthesia 5 hours ago | parent [-]

See the scoring docs: https://docs.arcprize.org/methodology