16GB total in SLI?

hmm - you could run a 7b quite easily on that.

Why not consider a GPU with 16GB in one unit?

BTW you need a minimum 8GB to run the 7b models, some are more optimized these days, but you can check on huggingface

Reply to this note

Please Login to reply.

Discussion

I already own the 2 1070s, so I don't want to buy new hardware