jingles on Nostr: On-device generative machine learning models are coming to Macs. Apple managed to ...
On-device generative machine learning models are coming to Macs.
Apple managed to squeeze a large language model into a MacBook Pro M2, it runs 25 times faster and models 2x larger, by storing the models in flash memory, made possible on M chips.
https://arxiv.org/pdf/2312.11514.pdf
Apple managed to squeeze a large language model into a MacBook Pro M2, it runs 25 times faster and models 2x larger, by storing the models in flash memory, made possible on M chips.
https://arxiv.org/pdf/2312.11514.pdf