| ▲ | cactusplant7374 5 hours ago | |
What is the TPS of DeepSeek? All of the LLMs I have tried are slow as molasses. \ | ||
| ▲ | selectodude 3 hours ago | parent | next [-] | |
I pretty reliably get 200 tokens per second on deep infra. | ||
| ▲ | micw 5 hours ago | parent | prev [-] | |
I use TensorX (EU hosted) and get 330TPS | ||