Remix.run Logo
Neywiny 3 days ago

I may mention it for my next schematic, but they'd probably want to understand the data flow and run everything locally. In that this is a wrapper around the other models (and full credit due, clearly not just a dumb wrapper like an extra prompt at the front of a chat bot), this should be possible, yes? Run the part that queries the models locally, point that to our locally hosted LLMs, and we're good?

Otherwise we probably couldn't put many designs of substance in. Just the data security risk.

I may reach out from my corporate email tomorrow. It's public who I am and where I work but yes we certainly have a formal procurement process.