Replying to Avatar Stack Jarrow

Best budget machine for local LLM’s?

AMD Ryzen AI Max+ 395 --EVO-X2 AI Mini PC with 128GB RAM(which is doubles as VRAM)

Also has upgradeable storage

Goes for $1999 right now

Vs.

M4 Mac Mini Spec with only a max of 64 GB Unified Memory and M4 Pro CPU and maxed out storage of 8TB comes in at double the price with only half the RAM.

In theory the higher VRAM allows for higher parameter models.

Currently running a M1 MAX MacBook Pro with 64 GB so able to run some 70B parameter models and I got it used for half the price of the AMD GMK Tek PC. Thoughts if worthwhile to upgrade to the GMK Tek PC for local AI implementation? #llms #ai #asknostr
Avatar
Stack Jarrow 6mo ago

Also for context: I am not a Dev or even a vibe coder at current. I am running local models for experimentation and learning to code while using them as tutoring help for areas I lack in.

Reply to this note

Please Login to reply.

Discussion

No replies yet.