We do not have a "right", in practice, we have some degree of practical freedom.
Of course people who really don't like that freedom will play up the privilige vs right angle as they see fit to advance their goals.