david on Nostr: Do you process each event to load into neo4j as it is ingested by the relay? And do ...

Do you process each event to load into neo4j as it is ingested by the relay? And do you have a system to track events that were ingested by the relay but not loaded into neo4j for whatever reason?

My system is broken down into lots of steps that I run separately. I have to do that bc I’ll often ingest a large number of events at once and they come in too fast for neo4j to process them in real time. Example: when a new kind 3 note gets ingested, I have to see if it’s newer than the current one; if so, add new follow relationships and remove any that have been deleted.