How do they even test this on a model ? I mean it's a multimodal i get that but response time are too big or am i missing something ?

pixl97 2 hours ago | parent | next [-]

By making a simulation first so it can run as slowly as it needs to.

A different way to think of this is, consciousness is just a near real time video game with causal influence.

WarmWash 2 hours ago | parent | prev [-]

It drives step by step, very slowly.

The course looks like it is something that a human could do in 15 seconds, while Astra took 5 minutes.

	▲	aditya-ramabadr 34 minutes ago \| parent \| next [-]
		Yes! The models can choose their speeds and command durations. Fable for example took so long to pause and think between giving steering commands. Astra took less time but still the latency is so high that they have to pretty much drive slowly step-by-step. And definitely any human could do this way way faster, but inference speeds, latency, and intelligence get better fast enough that maybe in a year from now the models will be even more competent at this (but still probably worse than specialized models for driving). - Aditya, Tobias, Simon
	▲	pixl97 2 hours ago \| parent \| prev [-]
		While slow, we must remember that when most machines were invented they were far slower than humans and refined until the point they were much faster.