ynniv on Nostr: Unified memory is amazing, but it's more expensive per GB and slower at inference ...
Unified memory is amazing, but it's more expensive per GB and slower at inference than a box full of used 3090s.
It's been a long time since local metal mattered.
Published at
2024-11-25 01:19:57Event JSON
{
"id": "8aa4ddc590f010382b7752a5a5256378a131a8ee09833619870d8addd6c00ada",
"pubkey": "576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"created_at": 1732497597,
"kind": 1,
"tags": [
[
"e",
"0cf22ef4b9b99f672e81c1a718b0665783d570d0edb90e35830425552d1e9b55",
"",
"root"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "Unified memory is amazing, but it's more expensive per GB and slower at inference than a box full of used 3090s. \n\nIt's been a long time since local metal mattered.",
"sig": "0afd2a24d26f3c56f6fb2ebdf43e6f8b3c780a04a90e010e7c05c5f05d5a762fe3b6adef18d5a33fba55ac580b48f8b975c5b22c287b05add787edb453dfcb00"
}
