Actual size of the data is 60gb (the index size is 100s of gb)
Zstd compressed it’s only 13gb!
Discussion
I don't use wss://relay.damus.io, it's no my fault 🤭
Is this a Postgres? What specs do you need to run it smoothly?
postgres is too slow for nostr
MySQL? ElasticSearch?
lmdb
Interesting! Didn’t expect that. Need to read up on this a little bit.
Seriously? http://www.lmdb.tech/doc/index.html?
Yes strfry is the fastest nostr relay atm. All others fall over and die.
When others fall over, what’s the common problem?
Writes or reads/filter requests?
My assumption is reads since different filters by the various clients need to be handled?
CPU bound. Other DBs just aren’t fast enough even when indexes are optimized. The sqlite relay failed the fastest. Snort social runs a postgres one and it eventually died. Strfry is so fast it almost feels like a cache.
Just a bit surprised. If so I learned a new thing nostr 🤙🏼
Is Redis or similar used as a fast cache?