Replying to Avatar Derek Ross

Umbrel releases LlamaGPT - A self-hosted, offline, private AI chatbot that can be installed on any device, not just Umbrel OS.

nostr:note1c0yxqnnmjpe74j0ku9sm7nkgh93jjlmdjqdvtljzy02y58pa95aqkuss92
Avatar
armstrys 2y ago

I didn’t catch that you could install this via docker. That’s awesome!

Reply to this note

Please Login to reply.

Discussion

Avatar
Derek Ross 2y ago

Yep. I just closed the repo, edited the yml to pick a custom port, and fired it up 🤙🏻🤙🏻🤙🏻

Avatar
armstrys 2y ago

Which size model are you running and how are the results? I may have to run a few comparison tests

Avatar
Derek Ross 2y ago

My "server" only has 16GB of RAM so I don't want to take all of the available memory for just that container. I'm using 8GB now.