This is really cool! Since this can be hosted directly in my local machine, I would love to give it a try. I use gpt models a lot. Would let you know how it goes.

Thank you:) Yes, it works with gpt and other 300+ models. Looking forward for your feedback!