| ▲ | Fergusonb 8 hours ago |
| Interesting - at time of writing, Carbon is claimed to be #1 on AA, but AA has not updated yet. Excited to try it, opus level benchmarks with their omniscience score and multimodality seems worth testing! |
|
| ▲ | inknight 8 hours ago | parent | next [-] |
| I don't trust AA scores after the last update to the index. Specially now that they are including private benchmarks that no one can test by themselves but only trust the entity doing them. |
| |
| ▲ | Marha01 7 hours ago | parent | next [-] | | I don't like it much, but I understand. It's the only way to be objective. Models are trained and benchmaxxed on any popular public benchmarks. | |
| ▲ | techmunky 2 hours ago | parent | prev | next [-] | | i was wondering why the pareto line moved so much. i did not remember it being all openai models. good to know i dont need crazy pills yet. | |
| ▲ | andriy_koval 2 hours ago | parent | prev | next [-] | | we need to make semi-educated decisions to pick model somehow, and AA is the best what is available | |
| ▲ | JacobAsmuth 7 hours ago | parent | prev [-] | | You'd prefer public questions and answer sheets that anyone can train on? |
|
|
| ▲ | verdverm 8 hours ago | parent | prev [-] |
| AA just updated their intelligence index to v5 https://artificialanalysis.ai/articles/artificial-analysis-i... https://news.ycombinator.com/item?id=50268868 https://theainewsreport.com/2026-10-28-artificial-analysis-i... IMO it emphasizes the wrong things if we are interested in "intelligence" |
| |
| ▲ | machiaweliczny 7 hours ago | parent [-] | | I think it's best ranking of models so far | | |
| ▲ | verdverm 7 hours ago | parent [-] | | yea, I probably agree, but I also do not find it represents real world use and performance There are many more aspects which affect outcomes |
|
|