I'm running an open-source non-custodial LLM on my Macbook that I use for programming questions when I'm on a flight for example.
You can too with GPT4All: https://gpt4all.io/
Discussion
What kind of size storage are you seeing?
It’s slick. Great UI. Have you checked out ollama.ai? That’s been my fave. Paired with oterm.
umbrel’s is really good too https://github.com/getumbrel/llama-gpt
Which model you recommend or use?
This is the way.
But ... I'm confused. Do these other language models "think" they are ChatGPT 3.5 or did I configure something wrong?
