I’ve found that doing the full requirements capture, planning, writing, reviewing, gardening loop with frontier models has worked quite well since last October, and phenomenally since Fable 5.

The key I’ve found is human peer review. The reviewer jumps on a live call with the developer, pulls up the PR with transcription on, and asks questions. At the end of the call, the transcript passes back into the coding agent and the PR is polished up, becoming more self-documenting, and the humans are left with some degree of common understanding of what’s going on.

I’ve been operating my team of ~15 this way for 9mo to great effect… there is simply no going back to the stone ages.

Here's an odd request for you, as a fellow New Jersey-an...

Can I watch/observe one of your review sessions?

Every few weeks, I hear the beginnings of a great approach towards working with LLMs but I rarely see it in practice.

If you're open to this, remote or in person, ping my username at gmail.