| ▲ | ceroxylon 4 hours ago | |
>The gateway adds under 1 ms for BYOK requests Amazing! Really brilliant idea, thank you for sharing this project. There is so much ground to cover in the LLM gateway / routing / reporting world, and this is a great start. The Tinker implementation is my favorite part, fine tuning is much better than a sea of context files. | ||
| ▲ | kfallah15 4 hours ago | parent [-] | |
Thanks! We are going to add continual RL via Tinker soon too | ||