Charlie Stross on Nostr: The Nvidia DGX GB200 server of 2024 consumes 120kW of power, about the same as the ...
The Nvidia DGX GB200 server of 2024 consumes 120kW of power, about the same as the Cray-1 supercomputer of 1975. The Cray-1 cost $7.9M and ran at 160 MFLOPS. The GB200 cost TK and runs at 1.44 exaFLOPS, or roughly ten billion times the power. But you can network 8 of these racks together, and AWS is building Project Ceiba around 20,736 of the CPUs (there are 72 CPUs per DGX server rack).
10 billion times more performance per watt, in 49 years.
https://www.theregister.com/2024/03/21/nvidia_dgx_gb200_nvk72/https://en.wikipedia.org/wiki/Cray-1Published at
2024-03-21 20:31:14Event JSON
{
"id": "540b5ab6fb6f3166d62a33cfe7a4dba17779441df60150f498bac15e6bc6f337",
"pubkey": "27712568050f479dd1204aa1126ca6b1917b59ee54b1a8f51f84fea4ec9785e7",
"created_at": 1711053074,
"kind": 1,
"tags": [
[
"proxy",
"https://wandering.shop/users/cstross/statuses/112135574312586927",
"activitypub"
]
],
"content": "The Nvidia DGX GB200 server of 2024 consumes 120kW of power, about the same as the Cray-1 supercomputer of 1975. The Cray-1 cost $7.9M and ran at 160 MFLOPS. The GB200 cost TK and runs at 1.44 exaFLOPS, or roughly ten billion times the power. But you can network 8 of these racks together, and AWS is building Project Ceiba around 20,736 of the CPUs (there are 72 CPUs per DGX server rack).\n\n10 billion times more performance per watt, in 49 years.\n\nhttps://www.theregister.com/2024/03/21/nvidia_dgx_gb200_nvk72/\n\nhttps://en.wikipedia.org/wiki/Cray-1",
"sig": "0e215e1429e45aee1682f3a6a156ee600005e8eb46507ed33599c3ca2c2b7cb32434379c08452992c9ac9a8631ac702145764864c0adaa8506b9a592f2ac111e"
}
