This is an interesting viewpoint, but isn't it also solveable?

Just because the human in the scenario only took vision as input, why does that matter to the training data and the model? The actions are the same.

To put it another way, what about all the cultural context the human had, or the sounds, smells, past experiences at the same intersection, etc? Even Tesla can't record this, but I'm not sure that matters.