Is being asked to read a clock really a gotcha?

ianmcgowan 26 minutes ago | parent | next [-]

It is, apocryphally, a gotcha test for Gen-alpha. As is being able to return the correct change or make a phone call to a human being. Reminds me of the iRobot line: "Can you create a symphony?", "No. Can you?".

▲

arjie 5 hours ago | parent | prev | next [-]

Not if you are aiming at a general intelligence but it’s worth considering that this is a tool that may not be able to count the number of strawberries in the letter R but can still center a div.

▲

dghlsakjg 5 hours ago | parent | prev [-]

If I had to hire an engineer and there was one that could one shot the wang algorithm, but couldn’t read an analog clock, I would have no problem hiring them.

Also worth noting that both models got it wrong. Qwen made a mistake that humans very good at reading clocks would make. Deepseek made a mistake that a human who had just learned to read clocks would make.

	▲	CooCooCaCha 4 hours ago \| parent [-]
		It would be different if AI was known to be reliable but it isn’t, so this is less of a random failure and more a symptom of jagged intelligence. And with every one of these there’s always an attempt to minimize the problem by saying it’s just one silly failure.