Remix.run Logo
▲ ac29 2 hours ago

Have used decision models the same way: Had LLM generate/tune questions for Clef to label/extract emails with {useful work thing} content

Too early to say how useful this is versus existing techniques, the cool thing is this is the first thing I've found local models genuinely useful for. I think I was able to process 50,000 email questions per hour or so with Clef flash on Strix Halo with a custom engine. A modern gaming GPU would likely be much faster