A fine-tuned classifier purpose fit for a specific task can easily outperform a SOTA LLM on more modest hardware and often makes a lot more sense.