WonteetZebugs on Nostr: Thanks for the follow-up. I've been trying to run the 70B and it's slow with a ...
Thanks for the follow-up. I've been trying to run the 70B and it's slow with a general-purpose cloud provider (with 80GB of RAM and 16 cores). The RAM doesn't seem to get maxed out though. The cores, yes.
Published at
2023-08-25 03:19:33Event JSON
{
"id": "c2f6bd61761033bab2e1b86d008b863de5d0b69095e3feeb0a7edac5547e079d",
"pubkey": "e217899785048ee15da66ab1c4633b8679d141e96c526017d5e7b1991ce584b9",
"created_at": 1692933573,
"kind": 1,
"tags": [
[
"p",
"a6d9fa6142f2808ff2f8fc567996a9428051530f9de8801c559b691d0abd11e7",
"wss://relay.plebstr.com",
"techjunkie"
],
[
"e",
"fe726ef5f3f8ae62a6efba9788d8a4b6259dfe6b288bc901b9aea7a8434fcca4",
"wss://relay.plebstr.com",
"root"
],
[
"e",
"b93fe47f590e12cb84348094fa6f30df757dcf1bbfb97863f4929fd0b9d8c11b",
"wss://relay.plebstr.com",
"reply"
],
[
"client",
"coracle"
]
],
"content": "Thanks for the follow-up. I've been trying to run the 70B and it's slow with a general-purpose cloud provider (with 80GB of RAM and 16 cores). The RAM doesn't seem to get maxed out though. The cores, yes.",
"sig": "a4ad19901660cc703392d9f2d57782d102a17f2ed068c9d7e2a41844771a35e19d0a40ba574c7fdd070017d2811845a7814bd6b52a8e69f7bd6cdc5c6cdbdbe6"
}