"Looks like" being the operative keyword there. Do you feel like you're having a conversation with a peer when you prompt an LLM in the topic you're an expert of? For the love of God, I'd hope not. The whole point is that, even though these things are really good at generating what looks like human output, they are still just regular software algorithms.

▲

falcor84 2 hours ago | parent [-]

> Do you feel like you're having a conversation with a peer when you prompt an LLM in the topic you're an expert of? For the love of God, I'd hope not.

Yes, I do feel that. Make of it what you will.

	▲	applfanboysbgon 19 minutes ago \| parent [-]
		The only thing I can think is ... how? If I were to anthromorphize my experience with frontier models, it would be as a mentally challenged child with complete memorization of an encyclopedia and thesaurus. It has the ability to rapidly experiment and potentially succeed at tasks through trial-and-error, but not without constantly corralling it in the correct direction because it would stick a fork in an outlet if unattended for five minutes. Tao's chat certainly doesn't give me a vibe of talking with a peer. Do you much often have conversations with colleagues where you write one sentence and then get five pages dumped on you, repeating ad infinitum? LLMs can be useful for rubber ducking, and sometimes the plausibly-related word-soup it generates so quickly will help your thinking along faster, but that's not the same thing as a genuine conversation. And it mostly looked like Tao was using it as an advanced calculator, firing off his own ideas for it to quickly do calculations on. I don't know why we need to anthromorphize these tools just because they generate sentences.