This finally got me to try a self-hosted LLM. Let me know if you find any good models. ollama was super easy to get running.
Discussion
ollama works great for me too but I wanted to use GPT4All (https://github.com/nomic-ai/gpt4all) but had issues downloading new models, constantly getting errors without any explanation. I'll have to look more into it tomorrow.