| ▲ | Towards a science of scaling agent systems: When and why agent systems work(research.google) | ||||||||||||||||||||||||||||||||||||||||||||||||||||
| 40 points by gmays 8 hours ago | 14 comments | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | Falimonda 28 minutes ago | parent | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I've been building something in this space ("Clink" - multi-agent coordination layer) and this research confirms some of the assumptions that motivated the project. You can't just throw more agents at a problem and expect it to get better. The error amplification numbers are wild! 17x for independent agents vs 4x with some central coordination. Clink provides users (and more importantly their agents) the primitives to choose their own pattern. The most relevant features are... - work queues with claim/release for parallelizable tasks - checkpoint dependencies when things need to be sequential - consensus voting as a gate before anything critical happens The part about tool count increasing coordination overhead is interesting too. I've been considering exposing just a single tool to address this, but I wonder how this plays out as people start stacking more MCP servers together. It feels like we're all still learning what works here. The docs are at https://docs.clink.voxos.ai if anyone wants to poke around! | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | zkmon 4 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
> We found that independent multi-agent systems (agents working in parallel without talking) amplified errors by 17.2x The paper sounds too shallow. The errors data doesn't seem to have a rationale or correlation against the architecture. Specifically, what makes the SAS architecture to have lowest error rates while the similar architecture with independent agents having highest error rates? The conclusion doesn't seem well-grounded with reasoning. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | localghost3000 5 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I’ve been building a lot of agent workflows at my day job. Something that I’ve found a lot of success with when deciding on an orchestration strategy is to ask the agent what they recommend as part of the planning for phase. This technique of using the agent to help you improve its performance has been a game changer for me in leveraging this tech effectively. YMMV of course. I mostly use Claude code so who knows with the others. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | kioku 2 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
I found the captions on Figure 1 quite interesting. > Average performance (%) across four agentic benchmarks improves consistently with increasing model Intelligence Index. > Centralized and hybrid coordination generally yield superior scaling efficiency, suggesting that collaborative agentic structures amplify capability gains more effectively than individual scaling alone. Then again, the deltas between SAS and best performing MAS approach are ~8%, so I can't help wonder if it's worth the extra cost, at least for the generation of models that was studied. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | CuriouslyC 6 hours ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
This is a neat idea but there are so many variables here that it's hard to make generalizations. Empirically, a top level orchestrator that calls out to a planning committee, then generates a task-dag from the plan which gets orchestrated in parallel where possible is the thing I've seen put in the best results in various heterogeneous environments. As models evolve, crosstalk may become less of a liability. | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | verdverm 6 hours ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||
gonna read this with a grain of salt because I have been rather unimpressed with Google's Ai products, save direct API calls to gemini The rest is trash they are forcing down our throats | |||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||