Vision on Nostr: With the 405B model? I don't think you can run this with only 64gb and no GPU, not ...
With the 405B model? I don't think you can run this with only 64gb and no GPU, not with acceptable wait times.
Published at
2024-07-25 20:10:12Event JSON
{
"id": "0000fce11b9f9667d3372bfccbf8cfa9188df7795e8c725d435d39e5fb213e78",
"pubkey": "5f2f5e70fb88daef29fa430171006436be26bdc80431c4e82bdb4ad59334d786",
"created_at": 1721938212,
"kind": 1,
"tags": [
[
"e",
"5d54a060fd0b988e59c401a9bfa190659a54c4be9714de8bdb2d92a4ca3b4cd2",
"",
"root"
],
[
"e",
"c083dabc7f8ce016d6344867c73805e5f1fb04a71957b498430b1996c00d8cde"
],
[
"e",
"dc326302c8bf0688debea7f434edabd7ab472e89510e522e2e98629225780c5e",
"",
"reply"
],
[
"p",
"f26606e331f128325ec99cd38782edbec134a5f911ea9fada7adce2ca9015b16"
],
[
"p",
"46fcbe3065eaf1ae7811465924e48923363ff3f526bd6f73d7c184b16bd8ce4d"
]
],
"content": "With the 405B model? I don't think you can run this with only 64gb and no GPU, not with acceptable wait times.",
"sig": "3fc370035d3c9a3dce3a499f44f1fe3d66b13b74c4832575e6df491af5a6dfd972f3f72b8465f1cb00d2df22359af0ef4bfd3a7bbe294804c97854c86aa634f2"
}