I agree it’s likely to be more labor intensive per lb of feedstock, but only 21% of calories in milk are protein and overall milk has ~10% of the initial energy. So you’re looking at ~2% of the energy from these crops ending up as milk protein.

That’s a lot of room for improvement which then means far less labor on growing crops.