Remix.run Logo
▲ cfn an hour ago

I tried Cerebras this week for my project and their 27b model at 2000tks would be perfect for it. Unfortunately it doesn't do the 2k tokens per second which is what I am looking for.

▲cubefox 18 minutes ago | parent | next [-]

What's your use case?

▲villgax 31 minutes ago | parent | prev [-]

And the fact that you will never be benefited from the batching they’ve explained either, you’ll be paying for every token sequential or parallel unlike nvidia or amd gpus