bryan newbold on Nostr: > Post data is compressed by turning it into GPT/Tiktoken tokens, then encoding the ...
> Post data is compressed by turning it into GPT/Tiktoken tokens, then encoding the 18-bit tokens using a variable-length bit representation, and then serializing everything into a Protobuf message (along with other metadata), which is then Brotli-compressed
wow
Published at
2025-01-14 00:23:34Event JSON
{
"id": "3b7575fb65d5797bf37960cb768f4ae02b9dfe8b3b60f6c73c6959f66a63153c",
"pubkey": "5f3fff56ca4fa8177f112910a34f4b664b6d20f4a9246ea79ca98a3021189bbb",
"created_at": 1736814214,
"kind": 1,
"tags": [
[
"proxy",
"https://bsky.brid.gy/convert/ap/at://did:plc:44ybard66vv44zksje25o7dz/app.bsky.feed.post/3lfnyd6saas2n",
"activitypub"
]
],
"content": "\u003e Post data is compressed by turning it into GPT/Tiktoken tokens, then encoding the 18-bit tokens using a variable-length bit representation, and then serializing everything into a Protobuf message (along with other metadata), which is then Brotli-compressed\n\nwow",
"sig": "4f6ea727206e2546590390b81f4e6f605d1ccdc809e3a9622e2e04bab37ce429be3ee3659f4a3f8cd6f7d8d45daacc26b20b7da58adf1e8e5aa720c476f8d8d6"
}