How important is it to be using SOTA? Or even jump on it already?

Feels a bit like when it was a new frontend framework every week. Didn't jump on any then. Sure, when React was the winner, I had a few months less experience than those who bet on the correct horse. But nothing I couldn't quickly catch up to.

> How important is it to be using SOTA?

I believe in using the best model for each use case. Since I’m paying for it, I like to find out which model is the best bang for my buck.

The problem is that, even when comparing models according to different use cases, better models eventually appear, and the models one uses eventually change as well — for better or worse. This means that using the same model over and over doesn’t seem like a good decision.