LLMs are absolutely capable of inventing new words, just as they are capable of writing code that they have never seen in their training data.