Either it's really valuable, and they can borrow money to pay taxes, or it's not and taxes are low. But people shouldn't be allowed to freeload on the work others do to make the property valuable.

Borrow money needs to be paid back. It's entirely possible and it wouldn't be a surprise someone retired lives for 30 or 40 years, accruing all that back taxes have to be paid up until eventually the taxes are worth more than the house.