Tuning my 1TB RAM, 128 core EYPC for DeepSeek right now

Reply to this note

Please Login to reply.

Discussion

1tb ram?

DRAM, not GPU. It's slow, but can r1 q8_0. The Mac will be faster, but costs four times as much

How did you get 1tb dram?

I have an erection

nostr:note1q47yfl7wpc29ma2adskj99l2ukrvgm70u7a5cw88rvz2pya4ds7s6wun6n

That's two threads per real core on two sockets with 64 cores each. Inference is memory controller limited though, so the simpler, cheaper DigitalSpaceport build seems better

#unixporn