What's the best FOSS, private and locally runable LLM?

Reply to this note

Please Login to reply.

Discussion

I don't think there is one LLM to rule them all, but I've liked WizardLM Uncensored 33B, Nous-Hermes 13B, and MPT 7B... Depending on your VRAM/RAM.

Have a look at gpt4all which provides a lot of local models!

Have you seen Prem AI?

Wow looks really promising. Were you able to deploy it yourself easily?

A few clicks. No command line