Laan Tungir on Nostr: Tried to run Llama llama3.1:405b Error: model requires more system memory (207.7 GiB) ...
Tried to run Llama llama3.1:405b
Error: model requires more system memory (207.7 GiB) than is available (39.0 GiB)
Hmmmm, maybe I'm not prepared for this.
Published at
2024-07-25 08:10:09Event JSON
{
"id": "679d602d6eda868d232267ddcda9514be0b78701b588c0cca555ef9a3a5e4805",
"pubkey": "1ec454734dcbf6fe54901ce25c0c7c6bca5edd89443416761fadc321d38df139",
"created_at": 1721895009,
"kind": 1,
"tags": [],
"content": "Tried to run Llama llama3.1:405b\n\nError: model requires more system memory (207.7 GiB) than is available (39.0 GiB)\n\nHmmmm, maybe I'm not prepared for this.\n\n\nhttps://m.primal.net/Jdhi.jpg ",
"sig": "5f7a0c27f39d90de83c872162813b0cc4645eae4b61e0056bc88a29e339e2983c57d18977dc8c023880332c24c459f57a0677cec4870d932951418ecbf200b7e"
}