I found this for using the NPU
https://blog.tomeuvizoso.net/2025/05/rockchip-npu-update-5-progress-on.html
but is seems very hacky and I guess the road the get it to work will be bumpy
ollama or llama.cpp, see: https://redlib.catsarch.com/r/OrangePI/s/TAEvKJAK4d
Don't know if it'll use the NPUs ootb, possibly not. That thread might provide some crumbs to follow up. Have no experience with that hardware myself. Curious, keep us posted.
I found this for using the NPU
https://blog.tomeuvizoso.net/2025/05/rockchip-npu-update-5-progress-on.html
but is seems very hacky and I guess the road the get it to work will be bumpy
No replies yet.