I think the limitation to team "let-people-do-what-they-want-even-if-it's-bad-for-them" is that it's rooted in outdated assumptions about what free will and coercion look like. Broadly speaking, libertarian notions of negative freedom assume a model of coercion with a very small footprint, primarily the threat of immanent physical violence. Similarly, it sees the exercise of free will as a binary action, rather than a spectrum of ability.

We entered this era a long time ago, where psychological insight and computational or chemical power can combine to override people's ability to make free choices. But I'm still not sure there is a widely shared philosophical or ideological framework that has fully digested and responded to these new realities yet.