Baldur Bjarnason on Nostr: For some context, the study uses AWS-hosted NVIDIA A100-SXM4-80GB GPUs, just like ...
For some context, the study uses AWS-hosted NVIDIA A100-SXM4-80GB GPUs, just like what’s used in most cloud-hosted generative model services. The power usage for a single GPU like that is around 400w (the instance has 8). For just one of the associated Intel CPUs the draw is around 200-240w AFAICT.
The biggest Macbook Pro power supply, for the 16 inch, is a 140w one, to give you some comparison.
Published at
2024-07-03 13:59:49Event JSON
{
"id": "6661709d670fbbe6abd8d26eb2ae074e98d1f273982a82ed9fa29c75be045396",
"pubkey": "11f94b00429b537972e1e4b4858c9a4226382961ef5995e3b77ff20bf92899d3",
"created_at": 1720015189,
"kind": 1,
"tags": [
[
"e",
"60d4dedf9f7335b1873e4c2354efd26984531cce13e93a485d4f362d6df0d90f",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://toot.cafe/users/baldur/statuses/112722915455370737",
"activitypub"
]
],
"content": "For some context, the study uses AWS-hosted NVIDIA A100-SXM4-80GB GPUs, just like what’s used in most cloud-hosted generative model services. The power usage for a single GPU like that is around 400w (the instance has 8). For just one of the associated Intel CPUs the draw is around 200-240w AFAICT.\n\nThe biggest Macbook Pro power supply, for the 16 inch, is a 140w one, to give you some comparison.",
"sig": "e3374047c579239e6a32082ea084ee8ff7f8660902b1041fd3ae46921f933c665c81e79f715895edab05cf19e5794a799890e97b5e3ea34217da11ac7bd86c01"
}
