DRAM, not GPU. It's slow, but can r1 q8_0. The Mac will be faster, but costs four times as much
How did you get 1tb dram?
Please Login to reply.
https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/
I have an erection
nostr:note1q47yfl7wpc29ma2adskj99l2ukrvgm70u7a5cw88rvz2pya4ds7s6wun6n
That's two threads per real core on two sockets with 64 cores each. Inference is memory controller limited though, so the simpler, cheaper DigitalSpaceport build seems better
#unixporn
