Nostr Web Client

M4 macs are becoming an interesting (and surprisingly cheaper) option for running local LLMs. They have lots of unified memory, integrated gpus and neural cores that are pretty good for running local models.

https://youtu.be/GBR6pHZ68Ho

🇵🇸 whoever loves Digit 1y ago

I'm most amazed by what my phone can do locally, and what my mom's lower RAM/weaker CPU phone can do locally

Reply to this note

Please Login to reply.

Discussion

jb55 1y ago

Inference is getting more memory efficient over time, and device memory is getting bigger. Exciting times.