Remix.run Logo
Havoc 3 days ago

>The device is largely useless due to a lack of software support.

It's pretty hacky for sure but wouldn't classify it as useless. e.g. I managed to get some LLMs to run on the NPU of an Orange pi 5 a while back

I see there is now even a NPU compatible llama.cpp fork though haven't tried it