| ▲ | cfn an hour ago | |
I tried Cerebras this week for my project and their 27b model at 2000tks would be perfect for it. Unfortunately it doesn't do the 2k tokens per second which is what I am looking for. | ||
| ▲ | cubefox 18 minutes ago | parent | next [-] | |
What's your use case? | ||
| ▲ | villgax 31 minutes ago | parent | prev [-] | |
And the fact that you will never be benefited from the batching they’ve explained either, you’ll be paying for every token sequential or parallel unlike nvidia or amd gpus | ||