Wouldn't that, uh, make your own headlights invisible to you?

Polarized light reflecting off a textured surface scrambles into nonpolarized light.

There are modest costs (signage & road markings shouldn't be perfectly smooth, retroreflectors work a little differently, and you lose a certain percent efficiency), but they're much less intense than the costs of the current situation.