You would need a data center full of these Nvidia premium GPU to run a 107B model.
7B or 8x7B models can run on a consumer PC.
I run 70B on my Mac … now curious to try 405b
Please Login to reply.
Give updates if you do, curious to see how it goes
