Remix.run Logo
fzimmermann89 6 hours ago

The switch by Artificial Analysis from per-token-cost to per-benchmark-cost shows some effect! Its nice that labs are now trying to optimize what I actually have to pay to get an answer - It always annoys me to have to pay for all the senseless rambling of the less-capable reasoning models.

svantana 5 hours ago | parent [-]

Did they? I'm looking at the Artificial Analysis leaderboard site now and I only see price as USD/1M tokens.