Remix.run Logo
dgellow 3 hours ago

A bit of a meta question: what are the most relevant benchmarks by now?

redox99 2 hours ago | parent | next [-]

Terminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy.

https://artificialanalysis.ai/evaluations/terminalbench-v4-0

tetec1 2 hours ago | parent | prev | next [-]

Epoch.ai has a global score and tracks many benchmarks: https://epoch.ai/benchmarks

andriy_koval 2 hours ago | parent | prev [-]

Nvidia and OpenAI claimed AGI, but you still have a job.