That's cool! I'd to dive a little deeper into AI hardware, how does this neural module compare to a big PCI express GPU? Btw will you be running in Kubernetes? I just did updated my blog series on getting started with k3s on ARM bare metal 👌

https://hashbang.nl/blog/kubernetes-cluster-build-with-raspberry-pi-and-poe-hats

Reply to this note

Please Login to reply.

Discussion

Cool!!!

The RK1 module should be very capable for doing neural / lots of data stuff, like running your own LLM (never done this before, so that would be a nice thing to experiment with).

https://turingpi.com/product/turing-rk1/?attribute_ram=32+GB

As for k8s, the Turing Pi II is build for this. It's on my learning backlog and I think I would start with docker swarm (as I'm more familiar with Docker): https://docs.turingpi.com/docs/docker-swarm-cluster-plan