> Assuming there's hundreds or thousands of self-driving cars suddenly driving in environment without any traffic lights.

Self-driving cars should (1) know how to handle stops, and (2) know that the rules for a failed traffic light (or one flashing red) are those for an all-way stop.