Remix.run Logo
Farmadupe an hour ago

It's a valid shift to move onto actually trying to read the article critically (which I don't mean in an insulting way -- If you assume a writing has something worthwhile to tell you, reading it critically is how you learn the worthwhile thing)

In this article, _I_ get unstuck right at the very first paragraph:

> Same driver, same track. The LLM is the star. Seventeen leading models driven round the identical 28-realworld task lap — one harness, same verbatim prompts, deterministic grading — and the results go on the board.

It jsut doesn't make much sense to me. At best, I think it can be glossed as... "I made an arbitrary benchmark which I'm not going to explain, and I plotted the results."

------

Getting my own opinions out, this is blatant slop. It claims to be "deterministic grading", but then almost the _entire_ webpage is editorialization. Examples:

* "If you only run one model, run glm-5.3"

* "opus-5 posts the best rubric on the default panel"

* "deepseek-v4-pro is nominally cheaper still at $0.0029 [...] treat it as a batch-only option."

* " It performed well on what it completed"