| ▲ | EgregiousCube 4 hours ago | ||||||||||||||||||||||
Their published benchmarks seem to indicate that it's pretty good at coding and multimodal, but VERY good at successful tool calls. What kind of use case would be best for that shape? | |||||||||||||||||||||||
| ▲ | xnorswap 4 hours ago | parent | next [-] | ||||||||||||||||||||||
Debugging and diagnosis is very tool call heavy, whether that's grepping / transforming logs, calling out to profilers/tracers, or even just writing up incident reports. Bug diagnostics is about being okay at coding but better at tooling. Given a good diagnostic report, it can be handed to opus for the fix. Opus is okay at writing reports, but it still regularly gets table widths wrong in typst documents, leaving the last column full of text but only a handful of characters wide. | |||||||||||||||||||||||
| ▲ | ai_fry_ur_brain 3 hours ago | parent | prev | next [-] | ||||||||||||||||||||||
Gemini 3.5 flash is better than fable at tool calling. Tool calling is probably one of the easier things to do post training for. | |||||||||||||||||||||||
| ▲ | paytonjjones 4 hours ago | parent | prev | next [-] | ||||||||||||||||||||||
I wonder if we'll start to see that pattern with every new release. Tool use likely changes rapidly, so the newest, rather than most intelligent, model may always have an edge. | |||||||||||||||||||||||
| |||||||||||||||||||||||
| ▲ | alansaber 4 hours ago | parent | prev [-] | ||||||||||||||||||||||
This sounds... kind of useless? Really good JSON or similar constrained decoder performance is interesting, but normal decoder > tool validator loop with good error message > tool retry is almost always able to get a tool to work second try, and input is cached so it's not expensive. | |||||||||||||||||||||||
| |||||||||||||||||||||||