diacone on Nostr: I built a "kappa" application which processes terabytes of data on top of kafka as a ...
I built a "kappa" application which processes terabytes of data on top of kafka as a storage backend where messages are stored in message pack binary format (and gzip compressed by kafka).
Must say I'm quite happy with message pack.
Published at
2024-11-16 10:09:05Event JSON
{
"id": "88686b87347d4499adf4dd6bbddbc5434a2fb6dc97dd8aad87d14b64089519c4",
"pubkey": "8633073b8567da97ad119fedd9716154aa283234cbb7d28d5131daa077d1cf7a",
"created_at": 1731751745,
"kind": 1,
"tags": [
[
"e",
"fb804add080068b4b6695d2b1d3acd31bf2e113998f92b6922500ff295ffb2e6",
"",
"root"
],
[
"e",
"fb804add080068b4b6695d2b1d3acd31bf2e113998f92b6922500ff295ffb2e6",
"",
"root"
],
[
"e",
"372142e72dfaedfb03b2cbd9b2901e9aea9d63cb6f08207bc79a08706af5d53e",
"",
"reply"
],
[
"p",
"4c800257a588a82849d049817c2bdaad984b25a45ad9f6dad66e47d3b47e3b2f"
]
],
"content": "I built a \"kappa\" application which processes terabytes of data on top of kafka as a storage backend where messages are stored in message pack binary format (and gzip compressed by kafka).\n\nMust say I'm quite happy with message pack.",
"sig": "e84984a6cf0aaf49e0fb1057aae82b3ffc6ba0eb36cdd8502e262a164b33a2045da0879056281ec3a1aee3d87380785a17353d2bf3fe6f852da6b1ee161f95d2"
}
