AI just amplifies an existing organization. This paper generally confirms what I think most already know.

Executives are blaming the model quality, but that’s not the problem. It’s how well the AI understands what it is supposed to do and how connected it is to the information it needs.

If that organization understands their business processes well and has a team capable of adapting to new things, they will likely get AI to work for them and pull ahead.

But if that organization barely has their stuff together and isn’t all that good at adapting, then AI will fail to deliver meaningful results.

It’s basically just like amplified prompt engineering. Provide a vague prompt and you’ll get a low quality answer. But if you can properly communicate what you need, the AI generally will perform.

So TLDR it’s typically not the AI failing, it is the organizations failing to use AI.