Why does it matter how many deserts you cross if you never get to where you want to go? I similarly can take 10 flights across oceans but never end up in the city I'm trying to visit. Sounds like in your metaphor the person is just crossing desserts because they want to with no goal or destination in mind.