Isn't that an argument to jump around? Since performance improves so rapidly between models

I think the idea is you might end up spending your time shaving a yak. Finish your project, then try the ne SOTA on your next task.

But it's also churning: I think it's more in the direction of you'll be more productive with a setup you've learnt the quirks of than the newest one which you haven't.