> Just use the LLM to make a thing that's actually good at what you need it to do.

I don’t have a deep understanding of this topic, but wouldn’t you also need a good amount of relevant data to train on?

Not if you take advantage of open-weight models and make an adaptor or distill its knowledge into the thing you want.