Even if the agent does everything, English is an imprecise description of what the code does.

So I personally at a minimum will want to talk “in code” about what code does.

Sure, but that only happens with a clean, concise, human readable codebase. If agents start working directly in binary, it'd be a lot harder to interact and understand what's going on and where the points of failure are..