Running DeepSeek locally on my Debian box ☑️

Reply to this note

Please Login to reply.

Discussion

100*C OOF bother

I don't think that metric is accurate because as soon as I stop running the model, it drops down to much more reasonable temperatures.

And when I put my hand where I know the CPU is, it sure doesn't feel like a 100 C.

I sure hope it doesn't feel like 100c on your hand XD

And? I'm toying with this idea, just waiting to see if everyone is going to catch yellow fever

"our" debian box. 😂

what GPU?

64G RAM and a old but snappy GTX 1660 super.

Running through Ollama and Open WebUI.

The deepseek-r1:1.5b is quick but not the most powerful. Deepseek-r1:8b runs fine but has a notable lag.

right on!

Yeah? what specs? I'd be curious if I could try it