Remix.run Logo
▲ santiago-pl 2 hours ago

I wish all the best to LiteLLM team with handling it again. I can imagine how challenging are situations like this one.

However, if anyone is looking for 20x faster and less "targeted" LiteLLM alternative - I'm work on one in Go. That's why GoModel it's called. https://github.com/ENTERPILOT/GoModel/

▲ghrl 2 hours ago | parent | next [-]

Sounds like a reasonable choice of a language.

I myself have written a small llm proxy in Go, doing nothing but injecting the real API key to outgoing requests while itself validating virtual keys it generates, and it works great.

▲santiago-pl 2 hours ago | parent [-]

Definitely it was a deliberated decision. Also enterprises adapt Go more and more.

▲TZubiri an hour ago | parent | prev [-]

If you don't use any LLM router, it's infinity times faster, and infitesimally as targetted.