I disagree that people are entitled to affordable housing where they desire to live. There are neighborhoods I could not afford to live in, and I am not entitled to live there. I live where I can afford, and this is the case up and down the market. If I want to live in some community, it's up to me to be able to afford it.

That said, if I can afford to buy property and want to build higher-density lower-cost rental housing on it, that should generally be my right as well.

The issue isn't that some communities are expensive. The issue is the deliberate engineering of extra housing expense extrinsic to the market itself using the force of law, which is a capability home rule grants exclusionary communities if not policed carefully.