Nostr Web Client

No but it looks a lot like another package I made last year :)

Ill give it a try and I hope its faster, but it wont make me stop hating indexeddb

Everything in browsers is stupid and awful. IndexedDB is implemented on top of SQLite for Firefox, I think, which makes it completely insane.

And on Chrome it's on a pile of JS on top of LevelDB which is already much slower than something like LMDB, but I don't know what I'm talking about.

Apparently the biggest issue (for reads) is that for iterating you have to switch on every row between native code and JS code. That gets much better if you fetch stuff in batches.

Also storing (and reading too, apparently) JS objects is much slower than storing JSON strings, because the act of deep copying objects and then encoding/decoding them is magnitudes slower than the superfast JSON.stringify/parse of browsers.

Reply to this note

Please Login to reply.

Discussion

hzrd149 5mo ago 💬 1

Wait, so storing strings is faster than objects? Did you test this anywhere and is that the reason your implementation is faster?

Also how many events did you test it with. The most I was able to get with my implementation was 100k

fiatjaf 5mo ago 💬 1

Oh, writes are super slow, I didn't benchmark writes. I guess I didn't even think about that part as I thought only reads were important, so maybe take my claims with a grain of salt.

For reads I think it doesn't matter how many records are stored so I only tried low values <5000 as I thought that was realistic for Nostr web clients.

Cesar Dias 5mo ago 💬 1

Have you tried absurd-sql?

fiatjaf 5mo ago 💬 1

Yes, years ago I replaced PouchDB with it, but it was also bad with writes and everything kept lagging. The real fix is to be moderate with the writes and do them slowly over time I guess.

Cesar Dias 5mo ago 💬 1

Just digging into the nostr-gadgets/store implementation, pretty interesting stuff, do you recommend using it?

fiatjaf 5mo ago

Yes, please. Let me know how it goes. I can probably be improved a lot still.

rkfg 5mo ago

NoSQL database implemented on top of an SQL database is a fantastic engineering joke but it's truly puzzling how it made it into production. I had to manually vacuum it so that my app stops killing my HDD even after I cleared the IDB completely. There are many reasons Firefox sucks but this one is also funny.