Who's running a home AI box? What sort of specs do I need for image generation, voice synthesis, text generation?

Reply to this note

Please Login to reply.

Discussion

lots of gpu memory (20Gb+) for diffusion sampling (image generation).

I have an i9 with Nvidia RTX 3060 and 128GB ram. Works well with most HuggingFace models up to falcon-7B.

I run Simple (stable) Diffusion on a Ryzen 5800X, with 32GB of ram, and an Nvidia 3070 (8GB) with no issues. It heats up the room like hell, but it works very smoothly.