As you say, farming is difficult, so if you're going into it with the expectation that it is idyllic, you have another thing coming. There is no "time off" on the farm. Some may enjoy that, but most people dreaming about it wouldn't.

It's much better to examine one's motivations for romanticizing the farm. Is it escapism from reality and the suffering endemic to it (in which case, you are only multiplying it by avoiding it)? Is it pride (too good to work)? Is it an impulse toward "immanentizing the eschaton"? Does your current job suck? Is the environment bad? Is it because you're living your life in a meaningless way?

Worth exploring.