LLM's are probabilistic but with a very limited range. They are tuned to be predictable enough to serve as a consumer product, so most ideas you get from them will revolve around the same concepts repeatedly.

People say this like it's a fundamental feature of all machine intelligence. We've bread deliberately docile golden retriever AI. That doesn't mean that we couldnt do the opposite.