Remix.run Logo
jgalt212 3 days ago

How can one use this for logging? Won't the LLM performance lag grind your application to a halt?

woadwarrior01 3 days ago | parent [-]

They're using MITIE[1] models for NER. And MITIE models aren't LLMs. They're way lighter: word embeddings with SVM classifiers.

[1]: https://github.com/mit-nlp/MITIE