> it seems like you're not taxed for the things you build on your land, but instead for the things other people built around your land.

Correct.

The article includes a section on land valuation that gets into those details.