▲ | fzimmermann89 6 hours ago | |
The switch by Artificial Analysis from per-token-cost to per-benchmark-cost shows some effect! Its nice that labs are now trying to optimize what I actually have to pay to get an answer - It always annoys me to have to pay for all the senseless rambling of the less-capable reasoning models. | ||
▲ | svantana 5 hours ago | parent [-] | |
Did they? I'm looking at the Artificial Analysis leaderboard site now and I only see price as USD/1M tokens. |