Global Feed Post Login
Replying to Avatar unclebobmartin

Good Morning Nostr-dosters. I'm watching the events pour in from eden.nostr.land. 100,000+ so far from last night -- and they're still coming. It might be a paid relay, but the volume is still pretty high!

I'm going to have to figure out a way to throttle the flow and gradually move it back in time. Something like limiting the batch to 1000, wait for the processing backlog to die down, and then get the next batch. The problem is that I can't ask a relay for events in reverse chronological order, so I'll have to interpolate how far back in time to move with each step, and then issue some correction subscriptions...

Sigh.

Anyway, I've got some other things to work on today too. Like, allowing #[1] references in articles.

Avatar
Blake 2y ago

I’m using Redis as an event steam, which has workers that persist to DB. Helps manage spikes and even out DB writes.

It’s working well.

Reply to this note

Please Login to reply.

Discussion

No replies yet.