The fact there are a lot of people around who don't think (including me at times!) does mean LLMs doing that are thinking.

Much like LLMs writing text like mindless middle managers, it doesn't mean they're intelligent, more that mindless middle managers aren't.