Remix.run Logo
chickensong 2 hours ago

You need to always be looking for what can be done deterministically and what can't. If it can, write a script or whatever is needed to make that happen. Your agent can help you figure this out. The agent becomes a glue layer for all your scripts. Use LLM judgement as an extra layer on top of a mechanical baseline.

> validating that the LLM didn't disable tests it didn't agree with

Provide a test runner and force the agent to call it. Have it emit something if you want evidence.