jb55 on Nostr: M4 macs are becoming an interesting (and surprisingly cheaper) option for running ...
M4 macs are becoming an interesting (and surprisingly cheaper) option for running local LLMs. They have lots of unified memory, integrated gpus and neural cores that are pretty good for running local models.
https://youtu.be/GBR6pHZ68HoPublished at
2024-11-24 18:18:13Event JSON
{
"id": "1cce0ac3a1d126d9754d07f629b8da8e375b6afd3b873929ba90b3a6f4e5243f",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1732472293,
"kind": 1,
"tags": [
[
"r",
"https://youtu.be/GBR6pHZ68Ho"
]
],
"content": "M4 macs are becoming an interesting (and surprisingly cheaper) option for running local LLMs. They have lots of unified memory, integrated gpus and neural cores that are pretty good for running local models.\n\nhttps://youtu.be/GBR6pHZ68Ho",
"sig": "f8f0b568bdfd2fb6e93ef8536328641932186c6461f3679f793ca0813897b6ba44b023c5836690b0fb6d8930168746a003173e7755822d166cc35c121bcdd3da"
}
