Remix.run Logo
▲ esperent 16 hours ago

> Yeah but if you ask the agent, they are probably tripping over their ad-hoc scripts and working around little issues all the time

I have done this periodically - the last time, coincidentally, was yesterday because I'd upgraded node and forgotten to reinstall playwright-cli so I noticed agents jumping through hoops to use it.

So I started a review session, asked why that was happening, and then asked the agent to do a few tasks of its choice using it and report any issues. Besides installing playwright properly it suggested a few very minor procedural updates but that everything else was fine. This is unusual for agents because they'll nearly always find things to do. If they say something is fine it's usually a sign that's it's genuinely pretty good.

I used gpt 6.1 sol / medium for the review.