Remix.run Logo
blibble 5 days ago

> But dollars to doughnuts someone will try something like this on a waymo taxi the minute it hits reddit front page.

and once this video gets posted to reddit, an hour later every waymo in the world will be in a ditch

skybrian 5 days ago | parent | next [-]

Alternatively, it happens once, Waymo fixes it, and it's fixed everywhere.

SoftTalker 5 days ago | parent [-]

How does Waymo fix it? They have to be responsive to some signs (official, legitimate ones such as "Lane closed ahead, merge right") so there will always be some injection pathway.

skybrian 5 days ago | parent [-]

They've mapped the roads and they don't need to drive into a ditch just because there's a new sign. It probably wouldn't be all that hard to come up with criteria for saying "this new sign is suspicious" and flag it for human review. Also, Waymo cars drive pretty conservatively, and can decide to be even more cautious when something's confusing.

Someone could probably do a DOS attack on the human monitors, though, sort of like what happened with that power outage in San Francisco.

theamk 5 days ago | parent | prev [-]

Given Waymo's don't actually connect LLMs to wheels, they are pretty safe.

Even if you fool the sign-recognizing LLM with prompt injection, it'll be an equivalent of wrong road sign. And Waymo is not going to drive into the wall even if someone places a "detour" sign pointing there.