> 90 of them would have come up with a standard that LLMs today easily clear.

> Now that we're here I think we can have a much clearer vision, and we can notice limitations that we couldn't have articulated before.

Okay, but had you been able to time travel and show them today's LLMs back then, how many of them would have agreed that we had "AGI", and how many would have instantly recognized the limitations they'd failed to articulate?

Because the way that some people talk about current models supposedly "passing the Turing test" makes me think they would have given ELIZA a pass too. It's just so obvious that none of them are convincingly human out of the box.

Eliza would not remotely pass the turing test as turing envisioned in his paper. And frontier labs are not optimizing for 'convincingly human'. If Open AI or Anthropic wanted, frontier models could pass much more human like.

Current models have passed a formally administered Turing test.

If you’ve never participated in a formal Turing test, either as human user or as a responder to the human, you might find it interesting, and possibly humbling.

> Okay, but had you been able to time travel and show them today's LLMs back then, how many of them would have agreed that we had "AGI", and how many would have instantly recognized the limitations they'd failed to articulate?

Feynman would laugh and say, "i told you so. i'll be at Gianonni's"