Simon Willison on Nostr: Midjourney generated images are hosted on the Discord CDN. I was curious how much ...
Midjourney generated images are hosted on the Discord CDN. I was curious how much space these take up... It looks like the answer is well over 148 TB!
Here's how I figured that out, using DuckDB to query remote Parquet files hosted on Hugging Face
https://til.simonwillison.net/duckdb/remote-parquetPublished at
2023-11-14 22:48:26Event JSON
{
"id": "71cbc9632e7be535fc446430694f717caa1403843c1b0364ac4b539ada6e9ce5",
"pubkey": "8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"created_at": 1700002106,
"kind": 1,
"tags": [
[
"proxy",
"https://fedi.simonwillison.net/users/simon/statuses/111411338080612842",
"activitypub"
]
],
"content": "Midjourney generated images are hosted on the Discord CDN. I was curious how much space these take up... It looks like the answer is well over 148 TB!\n\nHere's how I figured that out, using DuckDB to query remote Parquet files hosted on Hugging Face\nhttps://til.simonwillison.net/duckdb/remote-parquet",
"sig": "aeee8ed1189ffcd639faea54ec1b320e5f00c1ca40d78222f1626678cf2a031234440e6a7e5ebdbe4e6014aaf99048c31ca3358050ec4727b54d341d501edcc7"
}
