"Speculators" are not built-in middlemen, they are competing on bids with the buyer. Perhaps there could be some policy put in place to level the playing field between an owner-occupant who will bring mortgage-related red tape and an institutional investor who can make an immediate cash purchase, waive inspections, etc.