Remix.run Logo
simonh 5 hours ago

1966

https://en.wikipedia.org/wiki/ELIZA_effect

It turns out the limiting factor isn't how sophisticated algorithms are, it's how gullible humans are.

ashetr 5 hours ago | parent | next [-]

What does that have to do with the Turing Test? The TT has clear rules: There are judges that have a dialogue with anonymized AI/humans. The humans cannot cheat and impersonate a machine, they have to act normally. The AI obviously should try to sound human.

No AI would pass this test with experienced judges.

pibaker 2 hours ago | parent | next [-]

Colloquially the Turing test is just a stand in for "can a human mistake a computer for a person." No need to overcomplicate it.

stavros 5 hours ago | parent | prev | next [-]

You think current frontier models couldn't pass for a human on an online chat? You and I have very different perceptions of reality.

stickfigure 3 hours ago | parent | next [-]

I think that if you have a long enough chat, yeah, I think you can figure out who's meat. The original rules for the TT specified a short interaction, but I can probably accelerate it by pasting in large code snippets to force early compactions.

frollogaston 4 hours ago | parent | prev [-]

Sounds like something we could settle right here and now.

stavros 4 hours ago | parent [-]

Ha ha! Fool! You've been talking to an LLM all this time! Your wife is actually Haiku 4.5.

frollogaston 4 hours ago | parent [-]

Huh, should've known it was odd for my wife to always say I'm right (as the boomers would say)

mingus88 4 hours ago | parent | prev | next [-]

You’ve moved the goalposts.

You can always say “oh well these judges don’t have the experience to catch this type of AI.

The fact that you have to insert this qualifier, to ensure you always have a way to discredit the test, pretty much shows to me that we’re beyond it.

frollogaston 5 hours ago | parent | prev [-]

The test doesn't say that the judge has to be experienced. But I also don't care if some random gullible person can't tell the difference. Nothing passes the Turing Test for me yet.

Edit: Also doesn't say anything about who the human test subject is

simonh 5 hours ago | parent | next [-]

Of course, and I'm sure OP wouldn't disagree with you, it was clearly a joke for emphasis. Some people round here need to clean and calibrate their humour detectors more often.

frollogaston 4 hours ago | parent [-]

I wasn't responding to OP. I get the emphasis, the M6 Mac is very powerful.

cortesoft 2 hours ago | parent | prev [-]

How can you be certain you haven’t failed a Turing test?

frollogaston 2 hours ago | parent | next [-]

I've never done a test. That means 1. you know it's a test 2. you get like 5 back-and-forths or 5 minutes 3. you have a human subject to compare to. But pretty sure I'd pass anyway, as the judge or subject.

2 hours ago | parent | prev [-]
[deleted]
beardedetim 5 hours ago | parent | prev | next [-]

I think of this and the book the author wrote Computer Power and Human Reason every time I try to talk to product about the short comings of LLMs

applicative 3 hours ago | parent | prev | next [-]

It was always a bad test, despite the greatness of Turing. The human organism is built to 'project' humanity onto anything available; apart from this none of the peculiar phenomena of the so-called 'modern human' is even intelligible, even the possibility of science. I bring all that is in me onto you as soon as you seem to be saying something, and reciprocally. We do this at the drop of a hat, and all specifically human life depends on it. But this power shows its 'gullibility' with 'gods' as also with Eliza. I am not snide about it because it is overreach by something the significance of which is overwhelming , but one is indeed amazed by the failure to reflect on the part of the ones eg giving LLMs rights - to take extreme case of a very widespread cultus - as if /they/ were the rational party, not ancients placating the storm god.

bell-cot 5 hours ago | parent | prev [-]

Yeah...but in context, "gullible" seem a bit pejorative. Humans are also hopelessly incapable of sensing radioactivity, methanol in their alcoholic drinks, carbon monoxide, and a great many other things that our ancestors just didn't encounter much.

Though we're pretty good at sizing up a person's emotional balance/maturity and competence at familiar tasks. So maybe have an old blacksmith watch the AI/robot interact with horse owners for a while, then shoe their horses, and see how well it does.