| ▲ | landrew_ 4 hours ago | |
apparently it got docked points for editing files out of scope | ||
| ▲ | steve_adams_86 2 hours ago | parent | next [-] | |
This must not be weighted very heavily on the benchmark because if it was, Opus would bomb every test (half kidding) | ||
| ▲ | Dibes 3 hours ago | parent | prev [-] | |
Do you have a source for this? That would explain it, but could be a bit of a concern on the general focus the model at higher thinking exhibits. | ||