Or phrased in a different way: "Is an interface that forces drivers to look away from the road dangerous?"

To which the honest and obvious answer is that it is hard to imagine it wouldn't. My old 90s VW Polo could be operated completely blindly after driving it 10 times, any new car is much harder to operate blindly.