Yeah but every time anyone actually does implement a wealth tax they start it at like $500k or some similarly stupidly low amount and then everyone starts (somewhat rightfully) complaining that granny has to sell her house because she can't afford the tax.

It seems to obvious to me, like just start it at something like $5M. Nobody will be affected who can't afford it. It's like they're trying to implement it in a way that makes people hate it.