"where it works, it works" by that metric we already have agents which don't need any guidance to program

I'd say they're closer to 2010s self-driving cars; they still need frequent human intervention, even when on the happy path, to make sure they don't make a mess of things.