> safe drinking water, should maybe be one of the exceptions?

If we invert it to the actual reality (many places have unsafe drinking water), then we get "the right to avoid being poisoned by your government".

It sounds obvious to me that that should already be the case.

But I don't know much about water treatment. Maybe it isn't always feasible?

Do people just have to drink bottled water in some places? Or get reverse osmosis filters?