A 36% success rate on screwing in a light bulb means there's probably something to LeCunn's take that VLM/VLA models aren't going to be the thing powering tomorrow's robots, but only time will tell.

▲

heaney-555 2 hours ago | parent | next [-]

It's still very early days. There are many benchmarks that LLMs scored 36% on just 18 months ago that they're now at 100% on.

▲

LarsDu88 2 hours ago | parent | prev [-]

Where did you get this perf metric? I couldn't find it in the release

▲

striking 2 hours ago | parent [-]

Second chart (it's to the right of the first chart and clicking it to scroll is easier than otherwise)

	▲	LarsDu88 2 hours ago \| parent [-]
		Wow screw lightbulb is lower than tie bag or close ziploc. Pretty surprising.