Huge

Reply to this note

Please Login to reply.

Discussion

Blake uses this dashboard to test his database. I think daily user can also benefit from it.

Curious what the load would be like, maybe if we get a relay aggregator this could be hooked up to it.

Yep. That’s an image from my dashboards that’s back by my aggregator and relay.

The key issue is Nostr has around 15MM non-spam events. Indexes are getting big. Tables should likely start to be partitioned on kind/time. Partial indexes for recent data and perhaps limited indexing for historic. My DB is near 90GB already.

However, I’ve started to build support for effectively roll up statistics which can collect is near-real-time and basically give hourly/daily visibility per pubkey.

Basically, it’s too slow unless you either pre-warm cache or create roll up metrics, which is what I’ve got working now. I’ve seen a 400X query improvement in places - early data as tables are not filled with lots of different pubkey’s data yet.. but it’s significant anyway.

The hourly metrics are even cooler.

I’ve been working to productise this for a while now. I have enough to put something together and make it public. It’s still a chunk of work.

I thought of tiered access: things like past 7 days for basic, through to past 12 months hourly metrics for pro.

Businesses who migrate to or use Nostr are going to want stuff like this too. They are my ideal clients as a scale it out and Nostr grows.

Now you have a SaaS product, go build