Tim Chase on Nostr: There's been a lot of talk about efficient processing of high-volume data streams. ...
There's been a lot of talk about efficient processing of high-volume data streams.
Roll the clock back 30–40 years and the concern was the efficient processing of "high volume" of data coming off tape.
Sure the actual volume of data and processing speeds have increased over the years, but a lot of the same principles apply.
Services like Amazon's Kinesis or Datadog seem to be a modern-day manifestation of #sed & #awk processing. Only instead of ingesting data off tape, they're ingesting data off the internet.
The old arts never really die, they just come back around in new forms.
Roll the clock back 30–40 years and the concern was the efficient processing of "high volume" of data coming off tape.
Sure the actual volume of data and processing speeds have increased over the years, but a lot of the same principles apply.
Services like Amazon's Kinesis or Datadog seem to be a modern-day manifestation of #sed & #awk processing. Only instead of ingesting data off tape, they're ingesting data off the internet.
The old arts never really die, they just come back around in new forms.