| ▲ | Havoc 3 days ago | |
>But I rarely see an objective accuracy comparison. There are some perplexity comparison numbers for the previous gen - Orange pi 5 in link below. Bit of a mixed bag, but doesn't seem catastrophic across the board. Some models are showing minimal perplexity loss at Q8... https://github.com/invisiofficial/rk-llama.cpp/blob/rknpu2/g... | ||