A boon for the very thing you describe was the Black Death of the 14th century. The colossal depopulation of Europe increased the de facto bargaining power of peasants to the point where they could competitively seek out better labor wages and land concessions in places well outside their previous manor. Thus, many peasants did exactly this, to the point where the noble elites and monarchies of Europe tried to enforce tougher regulations and laws against free movement, wage increases and even conspicuous displays of prosperity by the increasingly wealthy peasant classes of society (many of who were also turning to mercantile ventures to further diversify their income.

As is usually the case with government social and economic dictates that attempt controls against the practical social and economic reality of the world around them, these laws slowly but inexorable failed, leading to the steady erosion of feudalism throughout Europe (though not everywhere at similar times, and in some places this repressive system lingered for centuries longer, ie: Russia, Sicily, etc)

If anything, for all its grim deadliness, the Black Death was oddly beneficial to the future social and economic flourishing of Europe, starting with the rise of the Renaissance, and leading from there to so many other things, for better or worse for the rest of the world.