| ▲ | qwesr123 21 hours ago | |||||||
Not sure why they don't compare with others, but they are actually leading on the benchmarks they published. See here (bottom) for a chart comparing to other models: https://marginlab.ai/blog/swe-bench-deep-dive/ | ||||||||
| ▲ | whimsicalism 20 hours ago | parent | next [-] | |||||||
is swe-bench saturated? or they switch to swe-bench pro because...? | ||||||||
| ||||||||
| ▲ | mistercheph 20 hours ago | parent | prev [-] | |||||||
It's like apple, they just don't want users or anyone to even be thinking of their competitors, the competition doesn't exist, it's not relevant. | ||||||||