| ▲ | santiago-pl 2 hours ago | |||||||
I wish all the best to LiteLLM team with handling it again. I can imagine how challenging are situations like this one. However, if anyone is looking for 20x faster and less "targeted" LiteLLM alternative - I'm work on one in Go. That's why GoModel it's called. https://github.com/ENTERPILOT/GoModel/ | ||||||||
| ▲ | ghrl 2 hours ago | parent | next [-] | |||||||
Sounds like a reasonable choice of a language. I myself have written a small llm proxy in Go, doing nothing but injecting the real API key to outgoing requests while itself validating virtual keys it generates, and it works great. | ||||||||
| ||||||||
| ▲ | TZubiri an hour ago | parent | prev [-] | |||||||
If you don't use any LLM router, it's infinity times faster, and infitesimally as targetted. | ||||||||