Remix.run Logo
sdesol 5 days ago

As a bit of a side note, I want to like Cerebras, but using any of the models through OpenRouter that uses them has lead to, too many throttling responses. Like you can't seem to make a few calls per minute. I'm not sure if Cerebras is throttling OpenRouter or if they are throttling everybody.

If somebody from Cerebras is reading this, are you having capacity issues?

gompertz 5 days ago | parent | next [-]

You can get your own key with cerebras and then use it in openrouter. Its a little hidden, but for each provider you can explicitly provide your own key. Then it won't be throttled.

omneity 4 days ago | parent [-]

Why would you go through openrouter in this case?

theshrike79 4 days ago | parent [-]

Easier to switch models

scottyeager 4 days ago | parent | prev [-]

Haven't seen any issues like this while using a key from their subscription plan: https://www.cerebras.ai/blog/introducing-cerebras-code

4 days ago | parent [-]
[deleted]