mleku on Nostr: so, so far, in writing my spider i see, from 1012 users, 2800 distinct relays this ...
so, so far, in writing my spider i see, from 1012 users, 2800 distinct relays
this spidering is pretty slow, i can see it's not going to be done more than once a day... i'm making it synchronous and linear so it doesn't hammer the other peers, but i'm also wondering how to put a lid on how many things it tries to do
like, right now, it's appending items to the existing thing that it's iterating through... need to think about this a little now that i've got it walking the web...
also been thinking a lot about maybe how i could save some time by doing a count request with larger lists of npubs
this spidering is pretty slow, i can see it's not going to be done more than once a day... i'm making it synchronous and linear so it doesn't hammer the other peers, but i'm also wondering how to put a lid on how many things it tries to do
like, right now, it's appending items to the existing thing that it's iterating through... need to think about this a little now that i've got it walking the web...
also been thinking a lot about maybe how i could save some time by doing a count request with larger lists of npubs