Looks like your infrastructure is not built to scale then 🤷
Discussion
The Noswhere indexer is currently handling hundreds of open connections with zero issues.
It can very efficiently handle duplicates while still being able to import a lot of events.
It goes through a custom event processing pipeline and within 1-2 seconds you’ll see it on aggr.nostr.land.
Seconds, not minutes.
With NFDB the query performance is significantly better as well, and allows faster queries on large datasets.
Is aggr.nostr.land going to be merged into nostr.land or it needs to be configured separately?
Currently separately. Later on you’ll be able to choose if you want it as 1 relay or 2 relays.
One has the benefit that you have a clear distinction between paid and free content, and the other saves data.