Replying to Avatar jb55

M4 macs are becoming an interesting (and surprisingly cheaper) option for running local LLMs. They have lots of unified memory, integrated gpus and neural cores that are pretty good for running local models.

https://youtu.be/GBR6pHZ68Ho

Avatar
jack 1y ago

Yeah, I just saw that video too, even just the new base model Mac mini looks great for a local LLM at your house - plus it doesn't actually use much power somehow (thanks Apple Silicon lol).

Reply to this note

Please Login to reply.

Discussion

No replies yet.