> presuppose competence in LLMs which simply doesn’t exist.

Then how do you explain the wild success at using them for development?

Guided by humans, code generators which have ingested the worlds’ code and can recognise and generate patterns can be useful tools. I wouldn’t personally qualify it as a wild success as we are early and there are significant downsides.

That doesn’t make them intelligent agents which think independently.