There's also this guy's build
https://xcancel.com/carrigmat/status/1884244369907278106
CPU only but for inference that should be fine.
671B param deepseek r1 running at 11tok/s on your desk with two of these. $180 a month for 2 years to pay this off, about the same as a chatgpt pro subscription. It’s a bit slower but you get privacy. Hmm…
https://x.com/alexocheema/status/1899735281781411907?s=46 nostr:note1rn95d949hlzjuaef20pvwly36wy090wpnqaypsn3g6q2jmc2lc2qeucxkd
Discussion
No replies yet.