Nostr Web Client

you need a powerful GPU to run these models. Usually something like a gaming PC has one. I thin new apple chips can also run them, but I don't know much about that.

I'm running local models like the one above on an nvidia 4070, and the fan goes spinning pretty hard

SoapMiner 11mo ago

I lost you at powerful GPU.🤣 I don't have any of that hardware. Not kidding, completely retarded when it comes to tech. 🤷

Reply to this note

Please Login to reply.

Discussion

gandlaf21 11mo ago

sorry 😅

GPU means graphical processing unit, it's a special type of computer chip that is specialized for parallelizing workload, which works well for AI stuff.

Let's hope this stuff becomes easier to run locally, so we don't have to use the evil Corp models 💛

SoapMiner 11mo ago

Is that same as PI 4?

gandlaf21 11mo ago

what is PI 4?

SoapMiner 11mo ago

gandlaf21 11mo ago

oh, raspberry Pi. not the same thing :)

Pi is not powerful enough (by a lot)

SoapMiner 11mo ago

Thank you. When it comes to tech I'm a complete retard. 😂