Replying to Avatar 0xtr

I'm a total noob to locally-run LLMs. How do you "use" it locally? I remember someone posted a link to an application that you could use to load the dataset and chat with the bot but I can't remember what it was called.
Avatar
YawningGoat 1y ago

https://ollama.com is pretty good for desktop.

If you want to run one on iOS, there’s also https://apps.apple.com/gb/app/mlc-chat/id6448482937

Reply to this note

Please Login to reply.

Discussion

Avatar
0xtr 1y ago

Are there any apps to run LLMs locally that also offers a UI with formatted text output similar to OpenAI's ChatGPT web interface?

Avatar
jimbocoin 🃏 1y ago

https://gpt4all.io/

Avatar
0xtr 1y ago

Thanks!

Avatar
jimbocoin 🃏 1y ago

Np. I used it a bit. Personally what I’d like to find is a model I can run on a server in my house that the fam can connect to. Especially one that can do code suggestions.

Avatar
0xtr 1y ago

Yeah that would be nice!