Right, this doesn't work in sovereign nations, only in federalism where there's a federal government that can guarantee some minimal set of freedoms to everyone (like the freedom to move to another state without impediment). Otherwise you just get the Berlin Wall.