| ▲ | jsheard 5 days ago | |
> So the "Verified" part of "SWE Bench Verified" means.. not "Verified" at all. Seems on-brand for an LLM-related thing to claim that it has verified something without actually checking. | ||
| ▲ | geekymartian 5 days ago | parent | next [-] | |
that was my exact thought. how fitting | ||
| ▲ | hhh 4 days ago | parent | prev [-] | |
Verified has a completely different meaning for this, it's that the questions have verified valid solutions. | ||