| ▲ | K0balt 8 months ago | ||||||||||||||||
I typically just use agentic frameworks to make workflows using RAG. I have done some fine tuning and LORA tunes but I find that a good model with agentic prompting handles most things with a little tweaking. I’ve not done much recently as I’ve been working on hardware for a new project, but I’ve seen some really cool new frameworks out there with computer use, memory, agentic prompting, and some new forms of document digestion that I’m excited to try if I can ever finish being distracted by supply chain chaos issues. | |||||||||||||||||
| ▲ | JCattheATM 8 months ago | parent [-] | ||||||||||||||||
As someone who hasn't done any local AI modeling but hopes to, could you clarify or explain your first sentence a little more? Happy to do my own research if you don't feel like teaching for free though - thanks for answering :) | |||||||||||||||||
| |||||||||||||||||