Yes, Asahi has GPU drivers since 2022: https://asahilinux.org/2022/12/gpu-drivers-now-in-asahi-linux/
Didn't have time to test local LLMs yet, but should be good. Drivers and the shared memory are working so I have 32 GB available for the GPU as well.
openoms
npub14t…shy62
2025-01-19 12:19:40 UTC
in reply to nevent1q…v50g
Author Public Key
npub14tq8m9ggnnn2muytj9tdg0q6f26ef3snpd7ukyhvrxgq33vpnghs8shy62Published at
2025-01-19 12:19:40 UTCEvent JSON
{
"id": "105af946388a9b1a909f051897e36c699bf8147efa8370088cc8e7ded82defd5",
"pubkey": "aac07d95089ce6adf08b9156d43c1a4ab594c6130b7dcb12ec199008c5819a2f",
"created_at": 1737289180,
"kind": 1,
"tags": [
[
"e",
"ebc6a3ce80aad6c5d20c1ce4dbed051bee7fa179005c45d9e2876e370f099db9",
"",
"root"
],
[
"e",
"64e6d1307ef00c629129ad2a434ce7e7ef09e35ae64be8598c9b0806909b25f5",
"",
"reply"
],
[
"p",
"aac07d95089ce6adf08b9156d43c1a4ab594c6130b7dcb12ec199008c5819a2f"
],
[
"p",
"3ba9b8cf58082bd37eec18455b26bb04a47f4a8e835ac18c7ea4348673ee1623"
],
[
"r",
"https://asahilinux.org/2022/12/gpu-drivers-now-in-asahi-linux/"
]
],
"content": "Yes, Asahi has GPU drivers since 2022: https://asahilinux.org/2022/12/gpu-drivers-now-in-asahi-linux/\n\nDidn't have time to test local LLMs yet, but should be good. Drivers and the shared memory are working so I have 32 GB available for the GPU as well.",
"sig": "4937db2a21dbed1c68386aaf48aa341df726b81e9e7e338b9590456bd421b828efe61725e8f4725a471b73872331bfd4677e4d7d7a954f1f877d542cda6f8275"
}