S!ayer on Nostr: 16GB total in SLI? hmm - you could run a 7b quite easily on that. Why not consider a ...
16GB total in SLI?
hmm - you could run a 7b quite easily on that.
Why not consider a GPU with 16GB in one unit?
BTW you need a minimum 8GB to run the 7b models, some are more optimized these days, but you can check on huggingface
Published at
2025-01-12 21:50:33Event JSON
{
"id": "db3af8cce9aa484ec56f31e020d9f02e0095c9e6173868ce31e81be2459c7308",
"pubkey": "cdecc31c6d9406e9a7d6b0067412aa661d9d31c8035c3fd65c06301d1cac3b92",
"created_at": 1736718633,
"kind": 1,
"tags": [
[
"e",
"9e632cf11dbb73931d315f6babb2877f856e6aac1d20d4a3c9a4c55468498a37",
"wss://nos.lol/",
"root",
"d70d50091504b992d1838822af245d5f6b3a16b82d917acb7924cef61ed4acee"
],
[
"e",
"9e632cf11dbb73931d315f6babb2877f856e6aac1d20d4a3c9a4c55468498a37",
"wss://nos.lol/",
"reply",
"d70d50091504b992d1838822af245d5f6b3a16b82d917acb7924cef61ed4acee"
],
[
"p",
"d70d50091504b992d1838822af245d5f6b3a16b82d917acb7924cef61ed4acee"
]
],
"content": "16GB total in SLI?\nhmm - you could run a 7b quite easily on that. \n\nWhy not consider a GPU with 16GB in one unit? \n\nBTW you need a minimum 8GB to run the 7b models, some are more optimized these days, but you can check on huggingface",
"sig": "c3817afc3a07c36a34abb3f8fa4857ac28d77819c1e64649e038548cd689041c291d14d3b356b2d18d4c73a3a1258d989d0a8c3d2644ad72f285a1d5e0e21584"
}
