JTaggart on Nostr: Ooooh fuck their llama 3.1 405b takes up 110gb vram A 4xmi60 setup would get you ...
Ooooh fuck their llama 3.1 405b takes up 110gb vram
A 4xmi60 setup would get you 128gb and be like 2k?
Published at
2024-11-01 19:39:40Event JSON
{
"id": "7211ded2d80c3702377503aea6cbe7274b7bdf3d7bf85a50dbc50fc0c176111b",
"pubkey": "bcbf9644d3f475d00eb9c6e467385ce16d4546c1a24222ccfa542bf776eaba95",
"created_at": 1730489980,
"kind": 1,
"tags": [
[
"e",
"c4662f4200505f3ac1f8d926736da2890aa49398c65aeb6283bfffe55278d227",
"",
"root"
],
[
"p",
"bcbf9644d3f475d00eb9c6e467385ce16d4546c1a24222ccfa542bf776eaba95"
]
],
"content": "Ooooh fuck their llama 3.1 405b takes up 110gb vram\n\nA 4xmi60 setup would get you 128gb and be like 2k?",
"sig": "386a65b40fef0ed47a50028861c2f9367d7e0c827d61e55011dc551b22a77b002204e6605ed1da90850dab7bcaa0cd1e0bf679810f606473007fa8eaf2e38a1d"
}
