You're not taking into account that housing prices can fall, not just stay flat and there are always things to fix and deal with in a house that you own.

Renting it out is also not always gauranteed or easy if you are not nearby or don't want to deal with being a landlord, so imho that flexibility is not really there in many cases.