No, but you can get a few tokens per second for $2k
Discussion
I went with two sockets and 1TB of RAM, but haven't gotten twice the performance of this yet: https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/
No, but you can get a few tokens per second for $2k
I went with two sockets and 1TB of RAM, but haven't gotten twice the performance of this yet: https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/