| ▲ | usaar333 5 hours ago | |||||||
i'd interpret that as rounding error. that is unchanged swe-bench seems really hard once you are above 80% | ||||||||
| ▲ | Squarex 5 hours ago | parent [-] | |||||||
it's not a great benchmark anymore... starting with it being python / django primarily... the industry should move to something more representative | ||||||||
| ||||||||