That's because the median person qualifies for a vastly larger mortgage than margin limit.
Margin trading is for the already-wealthy. You can get a home with near-zero assets.