What's the best open source AI you can download for free and use locally? (Don’t want to input my info into third-party servers.)
Discussion
Probably DeepSeek R1, but you'd need some very good local hardware. Otherwise, one of the Llama models.
thanks -- I downloaded Ollama for an old Mac, and it’s not very good.
Distilled Deepseek R1’s are really good for reasoning. I have found Gemma 2 27B to be great for general purpose. Qwen 2.5 Coder 32B seems to be the best option for coding
Thanks!
Hello Everyone 👋
For those looking to reach me personally for all things Nostr related inbox me on simplex chat app Using the link below 👇👉 https://simplex.chat/contact#/?v=2-7&smp=smp%3A%2F%2FenEkec4hlR3UtKx2NMpOUK_K4ZuDxjWBO1d9Y4YXVaA%3D%40smp14.simplex.im%2FSEKmN13uyX4OJlUxco0z9Nm9bPd4pK_K%23%2F%3Fv%3D1-3%26dh%3DMCowBQYDK2VuAyEA7kBBMVqOcbeghKMFplSPoiLQ903hkK3qBKtF_C1-LEo%253D%26srv%3Daspkyu2sopsnizbyfabtsicikr2s4r3ti35jogbcekhm3fsoeyjvgrid.onion
Venice AI ?
Deepseek R1 locally
BOOKMARKED!
You might want to look at trymaple.ai.
It's not local, but its privacy friendly, which I'm guessing might be your root concern.