The only thing I can think is ... how?

If I were to anthromorphize my experience with frontier models, it would be as a mentally challenged child with complete memorization of an encyclopedia and thesaurus. It has the ability to rapidly experiment and potentially succeed at tasks through trial-and-error, but not without constantly corralling it in the correct direction because it would stick a fork in an outlet if unattended for five minutes.

Tao's chat certainly doesn't give me a vibe of talking with a peer. Do you much often have conversations with colleagues where you write one sentence and then get five pages dumped on you, repeating ad infinitum? LLMs can be useful for rubber ducking, and sometimes the plausibly-related word-soup it generates so quickly will help your thinking along faster, but that's not the same thing as a genuine conversation. And it mostly looked like Tao was using it as an advanced calculator, firing off his own ideas for it to quickly do calculations on. I don't know why we need to anthromorphize these tools just because they generate sentences.