Building out an AI rig. What do you think? Is this a good start or am I wasting my time? What would you add or replace?
#worththesats ?
#asknostr
Discussion
you may wish to go for more VRAM if it's specifically for AI
also, i couldn't see the RAM, what kind are you getting? 🤔
looks like a badass build though 🎉
Just realized the whole cart wasn't in the shot🙄
I'm getting:
This is my budget atm but, the board has 2 more slots for ram + 1 more pcie x 16 for graphics so I could double both for under 2k in the future.
nice, big memory is good for both CPU inference and offloading
And what would you suggest for more vram?
(Preferably available on NewEgg because I'm paying in Bitcoin)
i would suggest a 3090 (same ~800k sat price as your current)
i found a few options on a newegg search https://www.newegg.com/p/pl?d=3090
or you could go for datacenter GPUs like nvidia H series, but you would need to rely on integrated graphics or another solution for display/output IIRC
I'm still waiting a few more years before deciding if I want to build an AI rig, but for now my only feedback on what I see here would be to get rid of the Nvidia stuff