Remix.run Logo
otterdude 3 hours ago

If most models were getting 100% on the test it would be an inadequate benchmarks.

What were seeing is all models failing to ace these tests.

"Benchmark Saturation" is term that promotes lowering the bar.

2 hours ago | parent [-]
[deleted]