Is surveillance special in that it needs total buy in from society, or else it's bad? Is any other aspect of governance held to that standard?

Surveillance isn't populist. The Patriot Act, for instance, is not representative of what taxpayers want to spend money on.