Exact same thing happed to me. I gave it a small/medium-sized ticket, walked away, came back to a 25,000 LoC monstrosity that both Fable and another 5.6 Sol agent said is 98% useless and should be thrown away.

▲

glouwbug 2 days ago | parent | next [-]

Contractors have been charging by the hour for eons. What makes you think tokens are any different for OpenAI?

▲

qarl2 2 days ago | parent | prev [-]

> monstrosity that both Fable and another 5.6 Sol agent said is 98% useless and should be thrown away.

This is why you should really have a sub agent review the code before allowing a commit.

Your harness will do it all for you. Just ask.

▲

pixl97 2 days ago | parent [-]

Based on the propensity for models to love their own words, a different model to check might be a good idea.

	▲	qarl2 2 days ago \| parent [-]
		Naw. The more verbose ones are more argumentative. They'll go at each other. It's a misconception that the same model will agree with itself.