you need a powerful GPU to run these models. Usually something like a gaming PC has one. I thin new apple chips can also run them, but I don't know much about that.
I'm running local models like the one above on an nvidia 4070, and the fan goes spinning pretty hard
I lost you at powerful GPU.🤣 I don't have any of that hardware. Not kidding, completely retarded when it comes to tech. 🤷
sorry 😅
GPU means graphical processing unit, it's a special type of computer chip that is specialized for parallelizing workload, which works well for AI stuff.
Let's hope this stuff becomes easier to run locally, so we don't have to use the evil Corp models 💛
Dm'd cuz I have some questions about doing this myself!
