sha2fiddy on Nostr: ETL app for LND coming along nicely… this is my first attempt at a real ...
ETL app for LND coming along nicely… this is my first attempt at a real application, coming from data wrangling scripts/notebooks.
Support and configs for:
- lndmon endpoints
- timeseries resolution & query range
- data processing
- write to local disk, S3 bucket
- write to csv, json, parquet
- partition by filetype, timestamp
TODO before publishing:
- lndmon, AWS creds
- datatypes / Pydantic
- logging
- basic unit tests
Phase 2 is to do the same for the Mempool API so you can automate extracting all the data from your Bitcoin and LND nodes… possibly bundled into one packag. 🤙
Support and configs for:
- lndmon endpoints
- timeseries resolution & query range
- data processing
- write to local disk, S3 bucket
- write to csv, json, parquet
- partition by filetype, timestamp
TODO before publishing:
- lndmon, AWS creds
- datatypes / Pydantic
- logging
- basic unit tests
Phase 2 is to do the same for the Mempool API so you can automate extracting all the data from your Bitcoin and LND nodes… possibly bundled into one packag. 🤙