Squiggs on Nostr: Just noting an idea that dropped into my head as I experiment with Meshtastic over ...
Just noting an idea that dropped into my head as I experiment with Meshtastic over LoRa, which I'm (almost certainly naively) thinking could allow "compressed" message size such that consumption of relay storage is dramatically reduced and transmission could be supported even on low-bandwidth decentralised mesh networks over LoRa radio...
- Train a custom, single-purpose LLM for a type of Dictionary-based Redundancy Compression (DbRC), such that messages can be losslessly described by the minimal-size format of reference(s) to the model (base best-match reference plus modifier references to refine it to an exact match)
- Clients and Relays can download a copy of the DbRC LLM (existing practicality of local voice recognition data files on mobile makes me think this could be too)
Each message is optionally passed as the reference(s) to the shared DbRC LLM
- Clients/relays without a local copy of the LLM can decompress (and compress, if this would ever be worthwhile?) via a service (assuming they have sufficient bandwidth)
I know basically nothing about compression approaches or custom LLMs, so is this even practicable?
Has the challenge of Nostr over low-bandwidth mesh networks been solved already?
- Train a custom, single-purpose LLM for a type of Dictionary-based Redundancy Compression (DbRC), such that messages can be losslessly described by the minimal-size format of reference(s) to the model (base best-match reference plus modifier references to refine it to an exact match)
- Clients and Relays can download a copy of the DbRC LLM (existing practicality of local voice recognition data files on mobile makes me think this could be too)
Each message is optionally passed as the reference(s) to the shared DbRC LLM
- Clients/relays without a local copy of the LLM can decompress (and compress, if this would ever be worthwhile?) via a service (assuming they have sufficient bandwidth)
I know basically nothing about compression approaches or custom LLMs, so is this even practicable?
Has the challenge of Nostr over low-bandwidth mesh networks been solved already?