> But they also prove that intelligence != consciousness.

They prove no such thing. We can't even prove consciousness in other humans.

https://en.wikipedia.org/wiki/Problem_of_other_minds

On that regard, arguing with thermometer is not a thing generally, but people arguing with LLMs is certainly common enough now to not be considered a completely marginal case. Given some people fall in love or move to suicide after interacting with these models, they are certainly different from even the most beloved dialectical rubber duck.