AI / LLMs are not intelligence .. they are just a prediction engine that has been branded as 'intelligence' by marketing employees

At the end of the day it is still making a best guess at what the user wants based on data it has seen before.

It still requires someone smarter than the output to be able to evaluate if the result is any good, or just hand waving.