What do you mean converting to binary format? thats what nostrdb uses for all stored data (flatbuffers + something custom for notes). No json is stored.
Discussion
my db is
u64 note_primary_key -> binary note
u64 profile_primary_key -> flatbuffer profile record with note foreign key
indices:
note_id⊕created_at -> note_primary_key
pubkey⊕created_at -> profile_primary_key
Same design as strfry
Tags should also be indexes
yes of course, they will be. also planning on a username index.
The hardest part is to render the front screen of Damus because it should request so many things to get close to Twitter I almost can see it fail. Ex.: request all likes (count) and all replies (count) for every single note in the front page is a hard task still to be done. It will require some kind of indexing to those 2 (replies, likes and zaps) for every note before the server reply. I’m stuck in this part of indexing.
It also will require a standard for complex query as we’ll be replying stuff that was not directly requested.