In the black-box approach, how do you know what is a reasonable task to give it? Just ask the agent about that also?

You don't give it tasks. You give it what you want. It decides the tasks, and then executes. Then you give it feedback. "black-box approach" here is just a fancy word for vibe coding.