So if I'm reading you right, the question is, is the context that matters a consumer, a government, or a business?

If a CEO just needs to write "optimise profits" ...

A CEO always just had to write “optimize profits”.

But IMHO what humans do is turn their intentions into reality using tools.

Intention is human, reality is perceived by humans. I feel that you need humans in the whole chain to communicate with reality (the context) and serve as translators and drivers for our tools.

Sorry that I can’t put more precise words here, but I am somehow convinced that there is a fundamental mechanism here that limits the reach of AI.