> otherwise we would expect changes in e.g. mortgage interest costs to be passed on

These aren't a universal cost. When rates change, some landlords' costs go up. But some don't. That lets the latter set the marginal price.

If everyone's costs go up the same amount, it's collusion without communication. In an inelastic market like San Francisco's, you'd expect prices to rise.