16GB total in SLI?
hmm - you could run a 7b quite easily on that.
Why not consider a GPU with 16GB in one unit?
BTW you need a minimum 8GB to run the 7b models, some are more optimized these days, but you can check on huggingface
16GB total in SLI?
hmm - you could run a 7b quite easily on that.
Why not consider a GPU with 16GB in one unit?
BTW you need a minimum 8GB to run the 7b models, some are more optimized these days, but you can check on huggingface
I already own the 2 1070s, so I don't want to buy new hardware