Remix.run Logo
jeffbee 6 hours ago

My car with its drive-by-wire brakes has a brake feedback simulator that gives the driver the kind of feeling associated with power-boosted hydraulic brakes. This is by far the most expensive single component in the car. Arguably these are just expensive accommodations for human flaws. A self-driving car wouldn't need them. Can't the self-driving system act directly on data like pressure, flow, and displacement?

jashmota 4 hours ago | parent | next [-]

That's indeed what we're trying to test to the extreme - to see how far we could go with just vision. We haven't done heavy excavation workflows yet, but we have some early success with some excavation workflows with just vision input and joystick action output (even without joint angle feedback!). We're betting on having really huge data with compact observation input and experiment to see if it holds water. If not we can always dial it down and add more sensors/feedback.

01HNNWZ0MV43FF 6 hours ago | parent | prev | next [-]

Maybe it doesn't matter for a car because feeling the car's motion tells you most of what you need to know. A car is not meant to touch anything but the road, in normal conditions. I think steering is the only case where force feedback is very important for a car - In the winters up here, I can feel the steering go loose when I hit a patch of ice.

I imagine an excavator, meant to touch and dig through things, and lift things, benefits from force feedback for the same reason VR would.

Have you played those VR sword games? BeatSaber works great because you're cutting through abstract blobs that offer no resistance. But the medieval sword-slashing games feel weird because your sword can't impact your opponent.

I saw a video recently of a quadcopter lifting heavy objects. When it's overloaded, it can't maneuver because all its spare power is spent generating lift to maintain altitude. If the controls had force feedback, the copter's computer could tell you "I'm overloaded, I can't move" by putting maximum resistance on the sticks.

jashmota 4 hours ago | parent [-]

Interestingly, we had some people try out VR teleop: https://x.com/Scobleizer/status/1970245161306464667

https://x.com/jash_mota/status/1969091992140304703

I think force feedback is key for small excavators, but not really true for 25+ tons excavators. Hence how easy it is for operators to accidentally kill someone with it.

cyberax 3 hours ago | parent | prev [-]

There are no drive-by-wire brakes in the US or Europe for regular cars. Your car's actuator moves the piston that is mechanically linked to your pedal.

So even if the electric system fails completely, you can still actuate the brakes.

jeffbee 3 hours ago | parent [-]

You can split hairs all you want. In my car the master cylinder that is connected to the pedals is only connected to the brake hydraulic system through a parallel (i.e. redundant) set of normally-open valves that are closed by solenoids when the ECU starts. When the ECU is functioning normally, the brake pedal is a video game controller, totally isolated from the hydraulic brake circuit by the closed master cut valves. In this normal operating mode, only the computer can pressurize the brake system using its second master cylinder, driven by an electric motor.

When the car is off or the system loses power, the master cut valves return to their open position, and the brakes are pressurized manually, like an old car without power brakes.

This is "brake-by-wire" to everyone, except apparently you.