> Do not confuse the mathematical description of physical processes as the world being made of math.

Again, this doesn't apply to information. A simulation of a computation really is equivalent to that computation.

> One is simple math that runs on electrified sand, and one is an unknown process that developed independently across a billion years.

Right, so you admit that it's an unknown process, which means you literally cannot conclude that it is different to what LLMs are doing.

> There are a billion trivial proofs that make the rounds as memes, like one R in strawberry, or being unable to count, etc.

No, none of these are definitive proofs that they are not thinking. LLM "perceptions" are tokens, the strawberry question is basically asking it to figure out something that's below it's perceptual range. This has literally nothing to do with whether the way it processes information is or is not thinking.

> Right, so you admit that it's an unknown process, which means you literally cannot conclude that it is different to what LLMs are doing.

If you truly feel human thinking and LLMs share more than a cocktail napkin's worth of similarity, I don't know what to say. Just treating it like a black box I can prove in minutes it's not thinking. Come on. I really don't get why people are so emotionally involved in this stuff.

It's not thinking. It's ok that it's not thinking. Maybe someday we'll get there, but it's not today.