Remix.run Logo
qwesr123 21 hours ago

Not sure why they don't compare with others, but they are actually leading on the benchmarks they published. See here (bottom) for a chart comparing to other models: https://marginlab.ai/blog/swe-bench-deep-dive/

whimsicalism 20 hours ago | parent | next [-]

is swe-bench saturated? or they switch to swe-bench pro because...?

Mkengin 17 hours ago | parent [-]

At least on swe-rebench it does pretty well: https://swe-rebench.com/

mistercheph 20 hours ago | parent | prev [-]

It's like apple, they just don't want users or anyone to even be thinking of their competitors, the competition doesn't exist, it's not relevant.