Excited to show you a new project I have been working on: the K8s Agent Orchestration Framework (KAOS) which helps you deploy and manage distributed multi-agent systems at scale If you want to support, do try it out, add an issue or give it a star!

The KAOS Framework addresses some of the pains of taking multi-agent / multi-tool / multi-model systems to hundreds or thousands of services. It started as an experiment to build agentic copilots, and has progressed as a fun endevour building distributed systems for A2A, MCP Servers, and model inference!

The initial release comes with a few key features including:

1) Golang control plane to manage Agentic CRDs; 2) Python data plane that implements a2a, memory, tool / model mgmt; 3) React UI for CRUD+debugging, and; 4) CI/CD setup with KIND/pytest/ginko/etc.

Links & Resources:

Docs: https://axsaucedo.github.io/kaos/ Repo: https://github.com/axsaucedo/kaos UI: https://axsaucedo.github.io/kaos-ui/

To be honest this project is solving the easy part, i.e. the compute where to run the agent. The part where the agent does something useful is like 99% of the value that unsolved for most organisations.

Not to be confused with KaOS, an Arch-based distro that focuses on a KDE Plasma-only desktop.