| ▲ | alexgarden a day ago | |||||||||||||||||||||||||
Yep... fair question. So AIP and AAP are protocols. You can implement them in a variety of ways. They're implemented on our infrastructure via smoltbot, which is a hosted (or self-hosted) gateway that proxies LLM calls. For AAP it's a sidecar observer running on a schedule. Zero drag on the model performance. For AIP, it's an inline conscience observer and a nudge-based enforcement step that monitors the agent's thinking blocks. ~1 second latency penalty - worth it when you must have trust. For both, they use Haiku-class models for intent summarization; actual verification is via the protocols. | ||||||||||||||||||||||||||
| ▲ | tiffanyh a day ago | parent [-] | |||||||||||||||||||||||||
Dumb question: don’t you eventually need a way to monitor the monitoring agent? If a second LLM is supposed to verify the primary agent’s intent/instructions, how do we know that verifier is actually doing what it was told to do? | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||