You can't just buy a horse and park it in a garage. You need to exercise it, give it vet care, shoes, feed it, deal with poop, etc. Or, pay someone to do that.

Unless you live in a place with dirt roads, or really love horses, I think a beater Toyota would win in terms of time and cost.