| ▲ | fchollet 2 hours ago | ||||||||||||||||
I'm all for testing humans and AI on a fair basis; how about we restrict testing to robots physically coming to our testing center to solve the environments via keyboard / mouse / screen like our human testers? ;-) (This version of the benchmark would be several orders of magnitude harder wrt current capabilities...) | |||||||||||||||||
| ▲ | causal 2 hours ago | parent [-] | ||||||||||||||||
Well, yes, and would hand even more of an advantage to humans. My point is that designing a test around human advantages seems odd and orthogonal to measuring AGI. | |||||||||||||||||
| |||||||||||||||||