Running various models locally on Ollama + Open WebUI. Some I sandbox and use RAG.
Really digging the DeepSeek-R1-Distill-Llama-8B right now.
I tried DeepSeek. It's TL;DR.
I need to mess with it some more. 😂
What have you done with it?
Please Login to reply.
I fed a starcoder model about 50 books on programming to be my on personal dev.
The deepseek model I fed about 35 books on hacking, OPSEC, and counter intelligence. Some interesting conversations with that one.
Great idea.