Replying to Avatar Jingles

On-device generative machine learning models are coming to Macs.

Apple managed to squeeze a large language model into a MacBook Pro M2, it runs 25 times faster and models 2x larger, by storing the models in flash memory, made possible on M chips.

https://arxiv.org/pdf/2312.11514.pdf

Avatar
gbs 1y ago

These new SoCs aren’t only CPU and GPU; AMX is an Apple undocumented matrix-multiplication coprocessor aka accelerator. A new horizon.

Reply to this note

Please Login to reply.

Discussion