> The more capable models never got close to the tool call limit because they tended toward combining tool calls (e.g. chaining multiple shell commands in one Bash tool call).

So tool call limits during benchmaxxing is why they have gained this behavior, Goodhart strikes again...

I look forward to the near future when training is more accessible to more people and we can have more experimentation and diversity in models.