LLMs are quick to jump to erroneous conclusions.

I think we already knew that.