The NPU is somewhat usable on RK3588(S(2)) boards, as long as the kernel you’re using is recent enough to have the latest NPU driver.

For a quick bring-up and implementation, take a look at this repo: https://github.com/Pelochus/ezrknpu

I have a Radxa Rock 5C (on Armbian) and it runs various models rather well. Trying to convert models is kind of a pain, though, so watch out.

Works great for me on Frigate. I am doing object detection on 3x 4k streams and it’s only 20% utilized.

Has anyone found a good table of tokens/s comparing different cards and systems (CPU, GPU, NPU etc.)?

Also: recent Geekbench should have NN tests: have you found dedicated comparison pages, and is which processor (C/G/NPU) is used clear?