Subnostr

Nicolas ₿ ⚡️ 🇦🇷🧉🤙💜 2y ago

I just need someone that helps me out with the appropriate python script that can

Connect to a public relay

- Get all events kind 1 with event Id and all other fields

- stay connected until subscription filter conditions are met

- store all those events in some form (I’m happy to put it layer on in a database)

Somehow I’m trying multiple repos but there is something in missing as I don’t manage very well queue, threading etc

I tried python-Nostr but and Nostrfastr and few others but couldn’t get it right

If someone had this very simple script I’d appreciate. I promise I’ll make good use of it and share some data mining with everybody afterwards

Reply to this note

Please Login to reply.

Discussion

Nicolas ₿ ⚡️ 🇦🇷🧉🤙💜 2y ago

#[1] es muy Rust pero tal vez le sea trivial este pedido en Python?

Code & Psychology ⚡️ 2y ago

Which operating system?

Nicolas ₿ ⚡️ 🇦🇷🧉🤙💜 2y ago

I just need it in python .. though I use Mac, it may not make much difference to the python script ?

Code & Psychology ⚡️ 2y ago

I am asking, because a lib did not work for me on windows from python-nostr, so I forked it.

Code & Psychology ⚡️ 2y ago

It shall be os independent but because of cryptography, there was a cryptography lib, that seem not to work on windows, so I just swaped it to a different one that works on Windows.

Nicolas ₿ ⚡️ 🇦🇷🧉🤙💜 2y ago

Oh yes there was a problem with secp251k1 I think.. but I managed to sort out…

I tried using the relay class from https://armstrys.github.io/nostrfastr/ and also the original from https://github.com/jeffthibault/python-nostr but I think I’m missing something.

my end goal is to download ALL notes from ALL relays.. going to one relay after the other in a database where I can then analyze a bit the activity each relay has.. so I need NoteID to compare content and few other stuff… so I’ll need to at some point store all in an SQLlite or postgres etc.. but that I can do later. I at least need to be able to connect, stay connected until my query is finished, one relay after the other

Code & Psychology ⚡️ 2y ago

I am not sure if relays support "all". Maybe you have to split your request into smaller requests, otherwise they won't go through.

Code & Psychology ⚡️ 2y ago

Did you get an error message back?

Nicolas ₿ ⚡️ 🇦🇷🧉🤙💜 2y ago

Well.. I was thinking adding a limit in my first subscription for example I connect now and I ask last X events… and then connect again or something like that.

Some how all clients are able to get a global feed?. So I would like to be able to have a view of the real deduplicated global feed across most of the realys… at least from 1 day.. to then do some stats

Code & Psychology ⚡️ 2y ago

I think downloading between timestamps are the best.

You set between now and yesterday midnight maybe.

Then yesterday midnight 2 days ago midnight.

Then you can slowly go back in time. But you shall be careful, because too much requests can get rate limited. So don't bombard the relays.

Nicolas ₿ ⚡️ 🇦🇷🧉🤙💜 2y ago

Correct yes I want to do it carefully but first I’d need to have a script that works. If you have a recommendation or any script that I can try it out even if I need to modify any library I can do that

Code & Psychology ⚡️ 2y ago

I used the python-nostr lib. That was working fine.

Code & Psychology ⚡️ 2y ago

I cut together a working code locally. How shall I send you?

Code & Psychology ⚡️ 2y ago

Sent you as a dm

Nicolas ₿ ⚡️ 🇦🇷🧉🤙💜 2y ago

Awesome 👏 I’ll check it tonight 🙌

Diego ⚡Paz 2y ago

Probaste con https://chat.openai.com/chat ?

Quizas te orienta