| ▲ | andy99 6 hours ago | |
I get ~55 Tok/s on my framework desktop with the 35B A3B q8 model, and so far am also very happy with the coding performance. | ||
| ▲ | cyanydeez 6 hours ago | parent [-] | |
did you upgrade to MTP? | ||
| ▲ | andy99 6 hours ago | |
I get ~55 Tok/s on my framework desktop with the 35B A3B q8 model, and so far am also very happy with the coding performance. | ||
| ▲ | cyanydeez 6 hours ago | parent [-] | |
did you upgrade to MTP? | ||