Cool!!!
The RK1 module should be very capable for doing neural / lots of data stuff, like running your own LLM (never done this before, so that would be a nice thing to experiment with).
https://turingpi.com/product/turing-rk1/?attribute_ram=32+GB
As for k8s, the Turing Pi II is build for this. It's on my learning backlog and I think I would start with docker swarm (as I'm more familiar with Docker): https://docs.turingpi.com/docs/docker-swarm-cluster-plan