John Dee on Nostr: AI noob checking in. ollama running llama3.1:8b is using 6.5 GB VRAM. The weights for ...
AI noob checking in. ollama running llama3.1:8b is using 6.5 GB VRAM. The weights for 8b are 4 GB.
John Dee
npub1lce…w464
2024-07-24 19:44:21
in reply to nevent1q…c9v7
Author Public Key
npub1lceznr3f426wc2g3crdamfy9cpels6w9g38wjtm6ufr76gz3vfjskpw464Published at
2024-07-24 19:44:21Event JSON
{
"id": "29478e99a31e19458338a5086420b3851b1ab615ff63660483c41ad664c2fa96",
"pubkey": "fe32298e29aab4ec2911c0dbdda485c073f869c5444ee92f7ae247ed20516265",
"created_at": 1721850261,
"kind": 1,
"tags": [
[
"e",
"00003c9dda7204845a2ef6a0a5a08d7572caf85dc738e34a05648f113a342f49",
"wss://nostr.wine/",
"root"
],
[
"e",
"00003c9dda7204845a2ef6a0a5a08d7572caf85dc738e34a05648f113a342f49",
"wss://nostr.wine/",
"reply"
],
[
"p",
"b2d670de53b27691c0c3400225b65c35a26d06093bcc41f48ffc71e0907f9d4a",
"",
"mention"
]
],
"content": "AI noob checking in. ollama running llama3.1:8b is using 6.5 GB VRAM. The weights for 8b are 4 GB.",
"sig": "648930c7bb59fd63b1a21f2459688d63382f5bbe860946ea291ab9a598ec4fa119c43b15738dc1957d9645903442334cfc297cbd95878ec5cd3b52f105a4a99e"
}