kevin 🦣 ✨ (he/him) on Nostr: Downloaded llama3.3 70B (40GB) just to find out it requires more RAM than I have to ...
Downloaded llama3.3 70B (40GB) just to find out it requires more RAM than I have to run it locally. 😵
#llm #llama #ollama
Published at
2024-12-12 14:07:26Event JSON
{
"id": "d21453a6a90e28848a76a560eaa879af60879933039021ad5115d116af7412ac",
"pubkey": "37afa79279b39a2ccd6433234cb48c0edad02e6b93d7c70a2ef8e99c22c63f74",
"created_at": 1734012446,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"llama"
],
[
"t",
"ollama"
],
[
"proxy",
"https://fosstodon.org/users/KevinGimbel/statuses/113640239685804378",
"activitypub"
]
],
"content": "Downloaded llama3.3 70B (40GB) just to find out it requires more RAM than I have to run it locally. 😵\n\n#llm #llama #ollama",
"sig": "30e9fc63182891c43b492642b68119795632493404bdaba9dbd9f7c3f492ad67841c395d49c72799e92327ce4c1e7901cf01b17e8e1adadb12cd04858b2fb8d8"
}
