I know my normal, non-self-driving car won't randomly slam on the brakes or swerve into a median. Even if I take my hands off the wheel, I know it will keep going straight-ish for a second or two.

A "self-driving" tesla is an adversary you need to supervise to make sure it doesn't take actions you wouldn't expect of a normal car.

As other posters have pointed out, it's like running an LLM with `--dangerously-skip-permissions`: I wouldn't `rm -rf /` my computer (or in the case of tesla, my life), but an AI might.