If somebody else doesn't want to be part of your little club, then they shouldn't buy a house that belongs to that little club in the first place. Pretty easy.