| ▲ | edifil 10 hours ago | |
I love it! I want to do the same, I guess mostly just concerned with hitting limits super quick, is there anyway you can see that info on telegram/whatsapp and route to different models? or are you building that into the tools and just using telegram as conversational | ||
| ▲ | hackerbone 10 minutes ago | parent [-] | |
So the model route layer should be something that you would have to internally build on the inference POV - like opting for an OpenRouter or creating your own AI Gateway. I've created an ai gateway myself with fallback models - this manages TPM/RPM rate limits and works seamlessly! | ||