I appreciate Karpathy for thinking out loud like this. We all feel the shift toward orchestration... just haven't seen a UI that fits yet.

I love seeing people experiment with RTS game UIs as agent orchestration interfaces. Mostly demos so far, but there is a ton of creative potential for orchestration UIs.

The biggest challenge is as LLM costs drop dramatically each year, the number of agents able to be orchestrated grows orders of magnitude. So the UI needs to be able to compress this growing information into something meaningful for effective human steerability. A constant moving target.

What's interesting is that the tooling seems to be moving closer to the metal (CLI, APIs, infrastructure) rather than up toward better visual interfaces.

My bet is that the orchestration infrastructure underneath is more durable than any UI layer. I've been building an orchestration system focused on reusable workflows, observability, and feedback loops because I think it's more valuable right now.