Remix.run Logo
sk4rekr0w 3 hours ago

You've overstated the conclusion. The SWE-bench series has had issues since its inception.

OpenAI no longer recommends SWE-Bench-Pro as a benchmark: https://openai.com/index/separating-signal-from-noise-coding...