| ▲ | ascii0eks84 an hour ago | |
What are pp/tg? I get 30t/s on 27B qwen. | ||
| ▲ | throwawayffffas an hour ago | parent [-] | |
pp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens. | ||
| ▲ | ascii0eks84 an hour ago | |
What are pp/tg? I get 30t/s on 27B qwen. | ||
| ▲ | throwawayffffas an hour ago | parent [-] | |
pp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens. | ||