You have the freedom to move to another country that is also ruled by the EU and where the same regulations apply? That doesn't matter in this discussion. In practice EU residents cannot easily leave.