I think one reason for this is that LLMs are sort of maximally if accidentally designed to fuck up our brains. Despite all the advancements in the last five years I see them as still, fundamentally, text transformation machines which have only very limited sort of intelligence. Yet because nothing in history has been able to generate language except humans, most of us are not prepared to make rational judgements about their capabilities and those of us that may be also often fail to do so.

The fact that we live in an era where tech people have been so investor pilled that overstating the capabilities of technology is basically second nature does not help.