Remix.run Logo
Havoc 3 days ago

>But I rarely see an objective accuracy comparison.

There are some perplexity comparison numbers for the previous gen - Orange pi 5 in link below.

Bit of a mixed bag, but doesn't seem catastrophic across the board. Some models are showing minimal perplexity loss at Q8...

https://github.com/invisiofficial/rk-llama.cpp/blob/rknpu2/g...