It takes 20 to 40 plant calories to raise one calorie of beef. So slaughtering a cow kills 20 to 40 times the number of lives as eating plants directly.
If anything, I would expect the number of insects, small mammals, etc. killed by harvesting animal feed to be higher than that of harvesting crops grown for people, on a caloric basis.