Replying to Avatar semisol

🔥

Relays like strfry, khatru, realy are great until they are not.

They work great for caching locally but when you get to scale it implodes.

You want to store 1TB of books. You have to rent a single server that can store 1TB.

But what if it goes down? So you buy a few more replicas. Then you try to shard events across servers and fail.

Have fun compacting the database or upgrading it every once in a while.

NFDB fixes this. Just like SQLite is great for small scale, Postgres is better for larger scale.
Avatar
ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 6mo ago

badger is better because it has split key/value tables. a lot less wasted time compacting every time values are written, and easier and faster to use key table to store some of the data that has to be scanned a lot.

for whatever stupid reason, nobody else in database development has realised the benefit of the key/value table splitting, even though the tech has been around for 9 years already.

probably similar reasons why so many businesses are stuck with oracle

Reply to this note

Please Login to reply.

Discussion

Avatar
semisol 6mo ago

at least some sane people realized, tbh

FoundationDB’s new Redwood engine, underlying architecture of S3, NFDB’s IA store as well

Avatar
ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 6mo ago

that's great. i think badger is cuter and more mature tho