Now building fulltext search into nostrdb 😅

Reply to this note

Please Login to reply.

Discussion

Always comes in handy.

🫂

I don't know what nostrdb is but yes we need search stuff

nostr:note1ala9z9yrjpekk7sf3s089ay2ywketrxfm97czwssl90tawmkxznqp86x66

Did you try specialized search engines like Apache Lucene and so on? Some of them seem to run very well on Android. It might be true for iOS as well.

It might be necessary to not only search on what the client side has, but also do some sort of backend search by using some caching service that agregates content from majority of public relay's data. Something along the lines of what nostr:npub16c0nh3dnadzqpm76uctf5hqhe2lny344zsmpm6feee9p5rdxaa9q586nvr and nostr:npub12vkcxr0luzwp8e673v29eqjhrr7p9vqq8asav85swaepclllj09sylpugg are intending on doing. For backend side, elasticsearch is a proven and great tool which uses lucene underneath. AFAIW very few relays implement searching, probably with time more will and more and more effectively. But the interesting thing is do they just search among the content users posted to them or do they aggregate content from other relays content as well and do a more widespread searching....?

Nip 50 is supposed to be that. But only very few relays implement it.

How should clients mix/score search results from several relays?

Each client does it's thing

Hi Will, Sam Samskies Advanced NOSTR search used to be the absolute best search implementation available. I was surprised that every client did not implement his search. Vitor Pamplona has hands down the best search currently available on NoSTR. Amethyst is truly making search a breeze on NOSTR! Talk to Vitor and @sam nostr:npub1vp8fdcyejd4pqjyrjk9sgz68vuhq7pyvnzk8j0ehlljvwgp8n6eqsrnpsw! Sam has written .ore amazing NOSTR code than most!

What approach are you taking?

Since nostrdb is build on lmdb, I’ve been looking at similar implementations https://github.com/XLPE/MeiliDB/blob/master/deep-dive.md

Can you do wildcard tag queries? Or is that a bad idea

Meaning the ability to search words and not just hashtags? 🥹

👀