I think one of the big problems is that there are different definitions of freedom, and not everyone agrees.

freedom TO vs freedom FROM