ynniv on Nostr: Agreed, and I run both for different things. I'm not personally there yet, but no one ...
Agreed, and I run both for different things. I'm not personally there yet, but no one expects to run a 405B model on unified memory.
Published at
2024-11-25 01:24:17Event JSON
{
"id": "70815d5b11a3c48b55da7713d5e6db050f7d0db1780d92402c471289224f65af",
"pubkey": "576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"created_at": 1732497857,
"kind": 1,
"tags": [
[
"e",
"0cf22ef4b9b99f672e81c1a718b0665783d570d0edb90e35830425552d1e9b55",
"",
"root"
],
[
"e",
"856afe7c9ac0bfe8130a3ecbc5f3b775dccc2649b6a66180cd910e25ff4f1808",
"",
"reply"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "Agreed, and I run both for different things. I'm not personally there yet, but no one expects to run a 405B model on unified memory.",
"sig": "bfec9f6ea906542a88130b224ea43014b91f04c743a2eaca6ad2b72d73e1d7b5cc01779b1a1b14f8e19e52c75c5c372fa7f78105091ac120ca6bd4867c16387d"
}
