For sake of completeness, another important reason:

4. These kinds of "social ills" hypothetically affecting only individuals, actually spill over to affect their families, and, at scale, communities.

That being said, in most cases it still doesn't justify this level of drastic intervention. Otherwise, cigarettes and alcohol and even Lotto would've been banned out of existence by fiat.