If I was doing this at scale, I'd be looking at two features in particular. Cached input tokens - leveraging the LLM's token cache to get a 10:1 cost advantage, and batch tokens, 2:1 cost saving.

The benefits of doing your own harness here is that you get to explicitly program around those specific things to optimize cost. And they both heavily benefit you in the way that these sorts of jobs work - at least for the hunt side of things.

TLDR - context management is pretty important for cost management when you're doing something repetitive in bulk.

> The benefits of doing your own harness here is that you get to explicitly program around those specific things to optimize cost.

I've toying with pi.dev to do something like that.

It's nearly as if, in the end, we'll still be coding after all.