> but humans don't need to operate at 20Hz to drive a ca

This is not a helpful statement unless you can claim what speed human sensors do work at. And it's going to be faster than the latency of $(sensor + server round trip) Hertz, not getting into LLM processing time.

It's also not subject to signal loss issues like anyone who uses a phone is quite familiar with. Unless you have narcolepsy.