| ▲ | blagui 2 days ago | |
7 t/s not sure how you can use this? And if it start thinking a bit. It works yes but that's really very slow. On top it's very low quant that impact the model quality. | ||
| ▲ | supermatt 2 days ago | parent [-] | |
> 7 t/s not sure how you can use this 80 t/s - maybe you need to finish reading a sentence before you comment on it? | ||