super cool. i am interested in how well you can harness these together! (software wise and stuff, and also gonna check out that mobo)
#ai #llm #localllama #localllm #grownostr #nostr #gfy
Not your own locally hosted LLM? You are giving away your thoughts and ideas to corporations/governments, who pay for what and how you think.
https://video.nostr.build/a027a52098435f570e0340e42b93296b0b608dd462b1c3a57873c254b50289a2.mp4
Discussion
I will install necessary nvidia items, such as the cuda tool kit. I would get PyTorch. Install transformers. Utilizing Hugging face. Having a linux machine running all gpu’s as one and dumping a whole model into vram is not a hard. I do admit I use a ton of help from ai and reddit groups, etc.
As far as mobo, I was also considering an ASUS SAGE, as well as boards from supermicro. Threadripper and Epyc are the only processors that I think about. The best bang buck for the vram is key. A healthy amount of system ram is wise as well.
You’re a pedophile
