Are there any apps to run LLMs locally that also offers a UI with formatted text output similar to OpenAI's ChatGPT web interface?
https://ollama.com is pretty good for desktop.
If you want to run one on iOS, there’s also https://apps.apple.com/gb/app/mlc-chat/id6448482937
Discussion
Thanks!
Np. I used it a bit. Personally what I’d like to find is a model I can run on a server in my house that the fam can connect to. Especially one that can do code suggestions.
Yeah that would be nice!
Looks like it runs on StartOS