Nice. I know it's time consuming but you should start series of shorts on your hardware + software setup. Plus detailed review of open source LLM software.

I'm relying on cloud computing currently to run my models but would be great to have my own server running.

All of this posted on #nostr too so we could zap each other :)