Nostr Web Client

Open source LLM interfaces need to be easier to install for newbies. Even the best option installs as multiuser for some reason 🤦‍♂️

Can anyone recommend better interfaces? Or should I ask the LLM 😆

First Man Photography 11mo ago

I’ve been using Ollama with Open WebUi. It works well, looks like Chat GPT and even has a few extra features.

It’s far from easy to install though and agree it needs to be easier. I’m running Ollama via Terminal and Open Web Ui in Docker.

Best model I can run with my hardware is Llama 3.3 72B and it’s a long way short of Chat GPT. Fun though.

The fact even I can do this, shows progress. It’ll be cool if it also incentives normies to start buying computers again, rather just using phones and tablets.

Reply to this note

Please Login to reply.

Discussion

HoloKat 11mo ago

I tried installing openweb but it set up multi-user dashboard and asks me to log in lol … I was like … wtf 😬 I don’t know how to make it single user now. Why would it ever default to multi user … so stupid…

First Man Photography 11mo ago

Ha. I have to log in too……although I don’t mind because it’s running on the network and stops the kids maxing out my GPU.

Although I enjoy tinkering, whenever I see the words GitHub, docker or terminal - I know I’m not in for an easy ride and I’m doing things beyond the scope of normies.

sudocarlos 11mo ago

https://github.com/valiantlynx/ollama-docker

I just run this and didnt have to set up anything except for nvidia drivers beforehand

HoloKat 11mo ago

DeepSeek v3 is now on ollama and supposed to rival ChatGPT 4o

Marcelinho 11mo ago

tried DeepSeek yesterday on ppq.ai

once again, everything sounds overrated to me 😅

HoloKat 11mo ago

Maybe it is 😆

But considering it costs nothing, that’s a huge improvement :)

Marcelinho 11mo ago

It's exciting what kind of data ends up in the LLM 🤓