WonteetZebugs on Nostr: Amazing! Trying out the free demo of Llama 2 70B from deepinfra. It's quick! Then I ...
Amazing! Trying out the free demo of Llama 2 70B from deepinfra. It's quick! Then I see they're using a 80GB GPU (A100) from nvidia? Seems to retail for 16,000 USD.
Ouch...
Published at
2023-08-24 16:10:45Event JSON
{
"id": "1e2bc5cc23d8b9b317cf2da113d12a1f5e9786b46f57b8ce7a55ea49b4a67602",
"pubkey": "e217899785048ee15da66ab1c4633b8679d141e96c526017d5e7b1991ce584b9",
"created_at": 1692893445,
"kind": 1,
"tags": [
[
"client",
"coracle"
]
],
"content": "Amazing! Trying out the free demo of Llama 2 70B from deepinfra. It's quick! Then I see they're using a 80GB GPU (A100) from nvidia? Seems to retail for 16,000 USD. \n\nOuch...",
"sig": "9837b81c8e391288a2ec642b5f7a1f2e29b86a6387b607a6f442a4a3362eae0e7321ff1ab998fb6f10666336f63ea60dadfe564e7d662901dff9d930254c58ff"
}