4e
4ed39cf4... 10mo ago

nostr bitwise search,

added gzip compression

https://nosbin.com/nevent1qqs0rhv4frd3hxtu290hf7f803k0ulhq66e3k8p822l8wr2upm799zgpzemhxue69uhkzarvv9ejumn0wd68ytnvv9hxgqg4waehxw309ajkgetw9ehx7um5wghxcctwvsq3wamnwvaz7tmwdaehgu3wvekhgtnhd9azucnf0gq3gamnwvaz7tmwdaehgu3wdau8gu3wv3jhvqgswaehxw309ahx7um5wgh8w6twv5q3jamnwvaz7tmwdaehgu3w0fjkyetyv4jjucmvda6kgqghwaehxw309aex2mrp0yhxxatjwfjkuapwveukjqg5waehxw309aex2mrp0yhxgctdw4eju6t0qyt8wumn8ghj7un9d3shjtnwdaeky6tw9e3k7mgprfmhxue69uhhyetvv9ujummjv9hxwetsd9kxctnyv4mqzxrhwden5te0wfjkccte9eekummjwsh8xmmrd9skc84hp7n

it seems gzip compressed binary data takes about half the size of what gzipped .content of notes take on average.

500 million notes should fit in 25 GB

still need to keep some reference to event ids to find them, linking row number with event id, but this does not need to be in ram while searching.

Reply to this note

Please Login to reply.

Discussion

Avatar
j 9mo ago

anon discussions on nostr

which client??

nostr:nevent1qqsqqqqetsg8ndnx08uk7mlrye3g2aswkl9cv2x8sz0hfemr5tc600qpz4mhxue69uhhyetvv9ujuerpd46hxtnfduhsygzw6ww0fytlsedmdvyklz82r8ggvzqnd9kwc3cr0hpeafk5t98jacpsgqqqqqqskygxgk

Thread collapsed