Global Feed Post Login
Replying to Avatar mike

No, a good LLM needs custom GPUs and a lot of RAM (over 100GB). The Nvidia DGX Spark is Nvidia's first attempt at a home dedicated LLM, but it can be beaten by a good home built custom rig.

II'm going to wait for the competition to catch up to Nvidia and force evolution and price competition before I get my private LLM up and running.

Avatar
mike 2mo ago

A lot of people like to use a M4 mac mini fully loaded with RAM, it comes pretty close to the Nvidia machine for about half the price.

Reply to this note

Please Login to reply.

Discussion

No replies yet.