Remix.run Logo
kaihwang 7 hours ago

most of the pain at scale isn't the agents themselves, it's observability. once you're past a handful you basically need per-agent tracing or you're debugging blind, worth borrowing tooling from how people do this for microservices

Var1377 5 hours ago | parent [-]

does anyone have any recommendations for stronger multi-agent observability. I've not really seen anything outstanding in this space yet

idempotent_ 4 hours ago | parent [-]

Depends on your setup but we've had success with building custom harnesses and processing metrics via OpenTelemetry + Prometheus. This is running on a massive K8s cluster spinning up pods per N agents.

If you are using a proprietary harness like CC or Codex then look into automatically ingesting their memory logs and internal datastores to track progress and then instrument the host to send back metrics