Nice. I know it's time consuming but you should start series of shorts on your hardware + software setup. Plus detailed review of open source LLM software.
I'm relying on cloud computing currently to run my models but would be great to have my own server running.
All of this posted on #nostr too so we could zap each other :)
Correction: not only LLM but throw in all you can find.
Open source AI is the only way out of the centralized shackles.
That’s the focus on the show, self hosted and sovereign Ai - and I’ll definitely be doing that. I agree, and think it’s really important. Will be covering a bunch of Ai tools that I’ve been exploring and using, all of them the local run versions.
