Replying to Avatar Nice and Kind Vic

Ok LLM experts...

If one wants to build a system to have their own chatgpt or LLM or whatever offline, what kind of equipment do you need in terms of disk storage, ram, cpu, gpu? gpu ram?
Avatar
utxo the webmaster 🧑‍💻 1y ago

Depends on the models you want to run of course, I think rtx 3090 is best value with 24gb of vram

Don't need insane hard drive or CPU or ram even

Reply to this note

Please Login to reply.

Discussion

No replies yet.