u7xo on Nostr: Most likely 7B or 14B. Mainly due to low CPU and no GPU. 64GB could extend into 32B ...
Most likely 7B or 14B. Mainly due to low CPU and no GPU. 64GB could extend into 32B models assuming you also need ram for all other services. But processing power is main issue with regard to mid to big size LLMs.
Published at
2025-02-22 03:24:30Event JSON
{
"id": "eebb9a8d0c60028b9c0dd242e5037a4da51673a81e3554e161bcecbd8c3ab9a9",
"pubkey": "54a47c743f5c116b23725629d6bd82ce4468c591c12ea22d5235f31968881497",
"created_at": 1740194670,
"kind": 1,
"tags": [
[
"e",
"4d2c7106a98986ee9616174b7d76903516f8f5d46a2dccc9722018575c0d3c6c",
"",
"root"
],
[
"e",
"ad313c3f40268ffa39a6151051020d6441009efa019584230686096d4cae2c85",
"wss://nostr-pub.wellorder.net",
"reply"
],
[
"p",
"bdf02ee67066fdeba255e1ac77d67ad95048ded50eb885a01cab39156e4282df"
]
],
"content": "Most likely 7B or 14B. Mainly due to low CPU and no GPU. 64GB could extend into 32B models assuming you also need ram for all other services. But processing power is main issue with regard to mid to big size LLMs. ",
"sig": "053f2ca3a641c4b5af4c67ef13ff6bf34af6d085232cf2100d29b2ca673106169913e8dedf9ceb8b0a658dedcea85f9ef1752550dbb7d9dc39de805ecbd46419"
}
