Remix.run Logo
Benchmarking AI Gateways: GoModel vs. LiteLLM vs. Portkey vs. Bifrost(enterpilot.io)
4 points by santiago-pl 7 hours ago | 9 comments
santiago-pl 7 hours ago | parent [-]

GoModel author is here.

This is my attempt to honestly compare GoModel vs LiteLLM vs Portkey vs Bifrost AI gateways.

sjeno 7 hours ago | parent | next [-]

Very interesting, I really wish that Python would stop being used for core things like gateways, just way way too inefficient and too much overhead. Great to see other options and the strengths of non-python stacks being highlighted, looking forward to trying out GoModel.

santiago-pl 6 hours ago | parent | next [-]

Thank you! Feel free to reach out to me over Discord in the case of any feedback or feature request.

verdverm 5 hours ago | parent | prev [-]

There seems to be movement within the Python/TypeScript ecosystem to replace implementations with Rust and continue distribution within said ecosystem.

I'm also looking to try out GoModel this weekend, met the creator in the OpenCode discord this last week. Looking to pair that with https://github.com/kubeopencode/kubeopencode

verdverm 5 hours ago | parent | prev [-]

Appreciate the reproduction, perhaps we can expand it to cover more providers / local and build out a larger perspective.

Thoughts on breaking out the benchmarking code into a separate repo?

santiago-pl 3 hours ago | parent [-]

Currently, I want to keep them close to the documentation, where I link to them directly. The fewer repositories I have, the easier it is to maintain them.

verdverm 2 hours ago | parent [-]

lol, are we headed towards monAIrepos?

santiago-pl 2 hours ago | parent [-]

I mentally treat it as part of the documentation right now.

verdverm 2 hours ago | parent [-]

Yeah, I hear you on that, I've been using what I call "mega-repos" where all the things for a single project live in the same repo. I retract my prior request upon reflection :]