SilberWitch on Nostr: Yeah, we actually have an organic view of the system. You could crawl the entire ...
Yeah, we actually have an organic view of the system. You could crawl the entire network/graph you are on, given enough time (yes, that's cheating, but give me a minute), but you will never need to crawl that entire network because useful information tends to cluster, and nobody needs _all_ information, but rather _useful_ information. It's more a question of finding the appropriate jumping-in spot and exploring in a radius from there.
This is essentially different than a centralized database, where you are forced to ratter through all records, until you find the appropriate one, so that having lots of records destroys efficiency or even ends in a time-out.
Furthermore, we expect similar information to cluster more and more, over time, so the need to crawl the system will diminish over time, despite the total amount of information increasing.
Published at
2025-01-14 21:58:14Event JSON
{
"id": "b38ccb69cfa7e1070a25dcb808221b95bf5e2457b4248ec0fb1c038048698bf6",
"pubkey": "fd208ee8c8f283780a9552896e4823cc9dc6bfd442063889577106940fd927c1",
"created_at": 1736891894,
"kind": 1,
"tags": [
[
"e",
"0eb03e4a4b3ba3a4722f5a6085c5173eb6b768839232d79319a34de6cc4ab017",
"",
"root"
],
[
"e",
"e101a7f9db61c896230bdeed5a1f87796329ee081d89f5c86c46b9f7e283e49a"
],
[
"e",
"aefd4884266274985d4d69e22500f67787e90dd77ee7ee7db1691d3101fc9150",
"",
"reply"
],
[
"p",
"dd664d5e4016433a8cd69f005ae1480804351789b59de5af06276de65633d319"
],
[
"p",
"fd208ee8c8f283780a9552896e4823cc9dc6bfd442063889577106940fd927c1"
],
[
"p",
"6e468422dfb74a5738702a8823b9b28168abab8655faacb6853cd0ee15deee93"
],
[
"p",
"5ea4648045bb1ff222655ddd36e6dceddc43590c26090c486bef38ef450da5bd"
]
],
"content": "Yeah, we actually have an organic view of the system. You could crawl the entire network/graph you are on, given enough time (yes, that's cheating, but give me a minute), but you will never need to crawl that entire network because useful information tends to cluster, and nobody needs _all_ information, but rather _useful_ information. It's more a question of finding the appropriate jumping-in spot and exploring in a radius from there.\n\nThis is essentially different than a centralized database, where you are forced to ratter through all records, until you find the appropriate one, so that having lots of records destroys efficiency or even ends in a time-out.\n\nFurthermore, we expect similar information to cluster more and more, over time, so the need to crawl the system will diminish over time, despite the total amount of information increasing.",
"sig": "a069c6f974a924d440457312560c2f5be7662afc5e32986639f3d8606111a738f463c775fe7366429821a9358a11d6c74db10212f9ef3d2a95609b2a391d2d83"
}
