This is silly. Cameras are cheap. Have both. Sensors that sense differently in different conditions is not an exotic new problem. The kalman filter has existed for about a billion years and machine learning filters do an even better job.

Cameras are cheap, but, as I understand:

1) it's not cheap to produce lidars at a stable predictable quality in millions;

2) car driving training data sets for lidars are much scarcer (and will always be much scarcer due to cameras' higher prevalence) and at a much lower quality;

3) combined camera+lidar data sets are even scarcer.