This finally got me to try a self-hosted LLM. Let me know if you find any good models. ollama was super easy to get running.

Reply to this note

Please Login to reply.

Discussion

ollama works great for me too but I wanted to use GPT4All (https://github.com/nomic-ai/gpt4all) but had issues downloading new models, constantly getting errors without any explanation. I'll have to look more into it tomorrow.