Avatar
Adam Nowotny
74dc43bc8059a8994ac2742c1e70b4347cc9c103fd79ea279735c58909729651
Code Removal Specialist. Adventurer. Motorcyclist. Citizen of No Man's Land. Decentralization. Privacy. Open Source. Linux.

Morocco, here we come!

Just published https://github.com/QC-Labs/orange-lab

Simplify setting up your private distributed infrastructure using nostr:nprofile1qqs8p6w3v4ljzrh7sjrysazgumzge22584jqhtcuv7y4hxwp6kasfvcpz4mhxue69uhhyetvv9ujumt0wd68ytnsw43qu0fmf8, Pulumi, K3s and Longhorn.

The cluster works even on a single laptop node but it's a great way to use spare CPU cycles and storage on other Linux machines you have available.

Once initial setup is done, you can run Ollama, Open-WebUI and stable diffusion image generation with:

pulumi config set orangelab:nvidia-gpu-operator true

pulumi config set orangelab:ollama true

pulumi config set orangelab:open-webui true

pulumi config set orangelab:automatic1111 true

pulumi up

This will create endpoints that anyone on your Tailnet can access, all wired up and ready to go.

Attackers also use Internet, isn't that suspicious? 👻 nostr:note1ke2q964m5v27s6qdjxx8zvzkxy2ll06qwm95ymeflrd9phdxfkvsmup8r2