What LLM are you using?

Preferably something open source and which doesn't track and store your prompts.

Looking to end my ChatGPT journey and go a more sovereign AI route, but can't seem to find a good replacement.

#AskNostr

Reply to this note

Please Login to reply.

Discussion

VeniceAI

Aa yes VeniceAI I remeber trying it out last year when it was still in the early beta stage, but I totally forgot about it. Thanks for reminding me, will definitely give it ago again. ๐Ÿ™๐Ÿผ

It's okay. There's definitely better. I'd like to explore some more as well.

Various models using Ollama.

Interesting, didn't hear of Ollama yet, will look into this tomorrow and try it out. Thanks for the recommendation Gigi! I appreciate it ๐Ÿ™๐Ÿผ

Deepseek-R1-0528 via Ollama is my default when I need a local-first model. It's pretty good IMO. For coding, I usually stick with Claude Sonnet 4

Thanks! Seems like Ollama is the way to go.

duck.ai

Thanks for your suggestion will check it out!

Have you tried PocketpalAI on the Zapstore? I believe you can download Ollama plus others and run offline if required. Mine has been a bit buggy on setup but im also not very technically gifted so you may have a better experiance.

I saw Pocketpal AI in Zapstore but didn't give it a try yet. Will check it out ๐Ÿ‘๐Ÿผ