>The generation doesn't mater as much to me as the memory bandwidth

I don't know man?

The generation kind of does matter. I'm not gonna lie, matrix multiplication units speed things up considerably. That hardware confers a material change in capability.

Maybe from M5 up, it doesn't matter? But you're definitely going to notice the difference between M1 and M5 for instance.