I inherited my son’s old Alienware gaming PC. It has an NVidia GTX 1070 (6GB). What generative AI model(s) should I run on it first? #asknostr
Discussion
Wizard LLM is hella fun and was running on my 1070 and i5 fine.
What does it do? Link?
https://huggingface.co/cognitivecomputations/WizardLM-13B-Uncensored
Just a off the rails uncensored llm. Pretty fun! I was running it in ollama locally.
What’s ollama? Sorry for the dumb questions. 🙏
Way to locally host an LLM.
A lightweight of the original should work fine.