What LLM are you using?
Preferably something open source and which doesn't track and store your prompts.
Looking to end my ChatGPT journey and go a more sovereign AI route, but can't seem to find a good replacement.
#AskNostr
What LLM are you using?
Preferably something open source and which doesn't track and store your prompts.
Looking to end my ChatGPT journey and go a more sovereign AI route, but can't seem to find a good replacement.
#AskNostr
Various models using Ollama.
Interesting, didn't hear of Ollama yet, will look into this tomorrow and try it out. Thanks for the recommendation Gigi! I appreciate it ๐๐ผ
Deepseek-R1-0528 via Ollama is my default when I need a local-first model. It's pretty good IMO. For coding, I usually stick with Claude Sonnet 4
Thanks! Seems like Ollama is the way to go.
Have you tried PocketpalAI on the Zapstore? I believe you can download Ollama plus others and run offline if required. Mine has been a bit buggy on setup but im also not very technically gifted so you may have a better experiance.
I saw Pocketpal AI in Zapstore but didn't give it a try yet. Will check it out ๐๐ผ