Remix.run Logo
bob1029 3 hours ago

> building your own harness is a huge undertaking, a deep rabbit hole.

I eventually gave up on this task. It's not possible to fight OpenAI or Anthropic's engineering teams. Their reasoning models have all kinds of undocumented back door access to the base models that you'd never be able to replicate from the outside. Even if you had full access you would not have the engineering man hours or experience to keep up.

I think this Agents API thing is a step too far, but Chat Completion is too cold now. Something approximating Responses API seems like the happy medium. You still get most of the control with the only blackbox part being the reasoning loop / tokens. Building agents using the GPT5.6 family w/ Responses API feels pretty close to Star Trek computer shit to me. I thought I was being clever with my DIY contraption on top of chat completion, but it wasn't even close. I have embraced the reality that I will need to use opaque reasoning tokens to give my clients the experiences they are paying me to provide.

ernsheong an hour ago | parent | next [-]

I built my harness in pi within herdr, I cloned (zipped and downloaded) 0xRichardH/pi-herdr-subagents and went from there, and used pi to build itself, adding gate workflow state control, provider fallbacks (I use many token plans), subagent skill injection, etc.

It is highly custom to my needs and wants, and I think every developer needs to do this. I only talk to my planner which plans, and it subs out to designer, oracle, coders, testers, and reviewers, etc. It is thus highly optimized for correctness. You can TDD or no TDD. You can fast track small changes. I tweak my harness dozens of times as I encounter new edge cases (esp when I switch models and encounter models not as good at following instructions).

As you can start to see, it is better to own the harness because nobody can build something custom that 100% fits your needs or development philosophy.

mingqiz 14 minutes ago | parent | prev | next [-]

Yet i find claude code worse than opencode.

lukebuehler 2 hours ago | parent | prev | next [-]

I've been working on a custom managed agent (see my other top-level comment), I find it is actually a manageable undertaking. It does feel herculean, but somehow doable. I do not find their hidden reasoning tokens to be insurmountable as long as you match the behavior of codex or CC (which takes work, but, again, is doable). My managed agent harness currently matches Codex on several benchmarks like Terminal Bench.

surgical_fire 2 hours ago | parent | prev [-]

> It's not possible to fight OpenAI or Anthropic's engineering teams

And yet, I find Pi so much better to work with than Claude Code.

teruakohatu 2 hours ago | parent [-]

I don’t find it better than Claude Code but much better than OpenCode. So I am curious why less is more in that context.