Replying to Avatar ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ

i'm pleased to say that in my work progress is going well but it is well into refactoring stage now... just had a massive leap forward with bulk iterations of the database, the time for completing a garbage collection count pass escalated to basically infinity after a couple of gigabytes of data but now i have got a counter that runs in 10 seconds on a 15gb store

i can see how i might even be able to do reindexing, fast data backup, and in the near future full text indexes and even maybe go the next step to graph database and design a better search API

filter searches are just the most minimal required index and search API for nostr, it will have to get a lot more advanced to provide the necessaries such as which you are constantly ruminating about
Avatar
Laeserin 1y ago

I love anything visual. Used to Kibana, but now everyone is all over the graphDBs and stuff. Haven't even touched that, yet.

Would love to explore the relay landscape with heat maps or topic cluster maps, etc. We haven't really even started thinking of the real cool-beans stuff that can be done with an open dataset.

Nobody else has that because they try to make money off of controlling access to the data or forcing you to use their crappy API.

Reply to this note

Please Login to reply.

Discussion

Avatar
ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 1y ago

yeah, in most cases they may have started with an open api but closed it up for reasons, usually proprietary ones, which is another way of saying spooks get a monopoly on the data access