> What LLMs will NOT do however, is write or invent SOMETHING KNEW.

Counterpoint: ChatGPT came up with the new expression "The confetti has left the cannon" a few years ago.

So, your claim is not obviously true. Can you give us an example of a programming problem where the LLMs fail to solve it?