I think the understanding is the most important piece here.

I've seen this called "cognitive debt".

If you don't understand the system you are building - if the AI gets too far ahead of you - then you lose the ability to reason about the system and make confident decisions about what to do next.

Reasoning about the system and making confident decisions is the job.