And this is because individual property rights must not be sacrosanct in a civilized society.

We already have a number of rules of what you can and can't do with your private property that I think most people agree on. You can't build a slaughterhouse right in the middle of a residential area. You can't dump your garbage into the water flowing through your property. Etc.

Those are rules we all agree on because they have immediate and very visible primary effects.

The things we're talking about now are less visible secondary effects, but they're still very real.

The ability of our entire society to be able to securely and affordably house all its members is a much stronger imperative than the ability of people in any particular area to have nice views, or neighbors who all share the same socioeconomic class/skin color/native language as them.

We should probably try to keep them to a minimum though, lest we stifle innovation. You wouldn't want to stifle innovation, would you? Or inadvertently destroy shareholder value?