I'm largely there with you... I've frankly always had mixed feelings about it. Nothing like having your brakes or steering lose pressure while driving down the highway.

That said, steering without at least hydrolic/power assist is rough on your forearms.

A vehicle setup without power steering is a lot different than a vehicle with inoperative power steering.

For one thing, they usually give you a bigger wheel, which helps with leverage. Power steering enables different steering geometries which likely wouldn't have been put together on a vehicle without power steering also.

Exclusive brake by wire and/or steer by wire seem like they will add confusion and delay, and perhaps increased risk of injury when dealing with disabled vehicles. At least in my life, it's been pretty handy to be able to get a non-responsive vehicle into neutral and push it to somewhere else in order to get it out of the way of traffic or to have better access to repair it. That often means using the vehicle steering to help direct it to a good spot, and the vehicle brakes to stop it when it gets there. Accelerator-by-wire is more acceptable, as vehicle without working electrics doesn't need a working accelerator pedal; I have driven one vehicle with what I assume was drive by wire with significant latency, it wasn't enjoyable, but it was usable.