Replying to Avatar First Man Photography

I’ve been using Ollama with Open WebUi. It works well, looks like Chat GPT and even has a few extra features.

It’s far from easy to install though and agree it needs to be easier. I’m running Ollama via Terminal and Open Web Ui in Docker.

Best model I can run with my hardware is Llama 3.3 72B and it’s a long way short of Chat GPT. Fun though.

The fact even I can do this, shows progress. It’ll be cool if it also incentives normies to start buying computers again, rather just using phones and tablets.
Avatar
HoloKat 11mo ago

I tried installing openweb but it set up multi-user dashboard and asks me to log in lol … I was like … wtf 😬 I don’t know how to make it single user now. Why would it ever default to multi user … so stupid…

Reply to this note

Please Login to reply.

Discussion

Avatar
First Man Photography 11mo ago

Ha. I have to log in too……although I don’t mind because it’s running on the network and stops the kids maxing out my GPU.

Although I enjoy tinkering, whenever I see the words GitHub, docker or terminal - I know I’m not in for an easy ride and I’m doing things beyond the scope of normies.

Avatar
sudocarlos 11mo ago

https://github.com/valiantlynx/ollama-docker

I just run this and didnt have to set up anything except for nvidia drivers beforehand