Remix.run Logo
stavros 5 hours ago

I've added an instruction: "do not implement anything unless the user approves the plan using the exact word 'approved'".

This has fixed all of this, it waits until I explicitly approve.

xeckr 4 hours ago | parent | next [-]

"NOT approved!"

"The user said the exact word 'approved'. Implementing plan."

Terr_ 3 hours ago | parent [-]

Relevant comedy scene from Idiocracy (2006):

https://www.youtube.com/watch?v=uAUcSb3PgeM

SsgMshdPotatoes 3 hours ago | parent [-]

Lol it only took 20 years

Terr_ 3 hours ago | parent [-]

I feel cheated, it's 2026. Where are the holograms and flying cars and orbital habitats?

Instead it's Idiocracy, The Truman Show, Enemy of the State, and the bad Biff-Tannen timeline of Back To The Future II.

AnotherGoodName 4 hours ago | parent | prev [-]

There’s an extension to this problem which I haven’t got past. More generally I’d like the agent to stop and ask questions when it encounters ambiguity that it can’t reasonably resolve itself. If someone can get agents doing this well it’d be a massive improvement (and also solve the above).

stavros 4 hours ago | parent | next [-]

Hm, with my "plan everything before writing code, plus review at the end" workflow, this hasn't been a problem. A few times when a reviewer has surfaced a concern, the agent asks me, but in 99% of cases, all ambiguity is resolved explicitly up front.

skeeter2020 4 hours ago | parent | prev [-]

what gung-ho, talented-but-naive junior developer has ever done that?