Exactly. Even if my eyes adjust well to the relative darkness with my lights, the effect is erased the instant I encounter a car coming on me on the opposite side of the road.

One thing that helps is to make sure you don't look at the headlights directly. It really helps to look at the white line on the side of the road when the other car is close to preserve your night vision.