Did you look at LiteLLM at all? It seems fine but Bifrost looks interesting too.

Yeah I looked at it, LiteLLM is functionally more mature.

The only reason I didn't go for it is I'm not a fan of Python dependency management, Bifrost is just a single executable that uses nearly no memory and is lightning fast.