jb55 on Nostr: I am only using 8gb vram and llama3.2 7b, but more is better obviously
I am only using 8gb vram and llama3.2 7b, but more is better obviously
Published at
2025-02-24 06:26:55Event JSON
{
"id": "1423ff069866d7b24561151b837cb5c24d7e8ef5ad4ef8bec86e6bbaac971341",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1740378415,
"kind": 1,
"tags": [
[
"e",
"2b2330606fdb89bd513b506b6ec34c36a3fdc70c22f720a4123f819e49518ef5",
"",
"root"
],
[
"e",
"a407cac14dae47614d7cb5268ac01a134a405794d6595fdab5c8bb58058e594c",
"",
"reply"
],
[
"p",
"1bf9f239dca1636149bc2f3fc334077ae959ea9607cacf945ef8f8bb227dc5e1"
]
],
"content": "I am only using 8gb vram and llama3.2 7b, but more is better obviously",
"sig": "5b0153dea8aae0bca3bb723a1ba853e9fdadf72df38d2a819fd12a7b3012740fe5552c2ca5de3fe7242f6cd156a4be51653af77481d1d639378fd29e6b053a98"
}
