I can highly recommend gliner2.5, been using it for tagging news articles, fine tuned on my home 5090 in a few minutes on 500 articles tagged by gpt 6.1, works fantastically. Deployed on hetzner running on a cpu .

gliner-style models are absolutely crazy, I learned about them a couple weeks ago when a co-worker fine-tuned an LFM encoder for promptable classification. as far as I know, you don't need to fine-tune; you can just prompt for classification. My co-worker's demo is here: https://huggingface.co/spaces/LiquidAI/prompt-routing