No billionaire owns a single physical house that is their entire worth and that is also their sole form of shelter.

Now if you are proposing a tax on all secondary homes worth $1M or more... I'm listening.