| ▲ | lacoolj 3 hours ago | |
Yet Opus 5.5 is only a few % under all of these benchmarks (cept the robotics and labor ones) Do we need new benchmarks or are the models just plateauing in general? Or is it something I just don't see? | ||
| ▲ | jeremyjjj 5 minutes ago | parent | next [-] | |
The same was said many times already. Like right before o1 and reasoning was released. Also, Opus 5.5 being so good definitely makes it hard to follow-up. Finally, for coding the SOTA models are so good already - models shouldn’t be what’s holding anyone back! | ||
| ▲ | andriy_koval an hour ago | parent | prev [-] | |
% improvement doesn't mean linear capability improvement. New solved tests likely follow some polynomial/exponential complexity curve. | ||