Just published https://github.com/QC-Labs/orange-lab

Simplify setting up your private distributed infrastructure using nostr:nprofile1qqs8p6w3v4ljzrh7sjrysazgumzge22584jqhtcuv7y4hxwp6kasfvcpz4mhxue69uhhyetvv9ujumt0wd68ytnsw43qu0fmf8, Pulumi, K3s and Longhorn.

The cluster works even on a single laptop node but it's a great way to use spare CPU cycles and storage on other Linux machines you have available.

Once initial setup is done, you can run Ollama, Open-WebUI and stable diffusion image generation with:

pulumi config set orangelab:nvidia-gpu-operator true

pulumi config set orangelab:ollama true

pulumi config set orangelab:open-webui true

pulumi config set orangelab:automatic1111 true

pulumi up

This will create endpoints that anyone on your Tailnet can access, all wired up and ready to go.