I’m probably going to need to clean up my relay again soon. Do you have a script that can spam detect and filter json?

Reply to this note

Please Login to reply.

Discussion

I’ve been playing around with strfry’s writePolicy.plugin system this weekend. Pretty basic checks for now, but am planning on getting more sophisticated with it soon. I’ll be sure to share whatever I come up with.

yup I’ve been playing with that as well, got one set up for my private strfry relay. Would be good to have a rate limiting one for the public relay.

#[4] should have those spam filter script. He/she implemented it on nostr.mom and nos.lol

I’ve got a pretty large training set of 13k (with some dupes) spam events. You could filter labelled as spam, and perhaps hash the content into a set. Then maybe check membership?

I also have around 28k pubkeys flagged as spam I can share directly. You could review them and then delete their events.

Failing those, you could use the ML to get spam scores.. but it likely is more computational.

I’ve just purged around 2.8MM spam events. Some I can’t detect easy yet - like bogus reactions and reposts. I see them in network traffic. I just can’t do anything automatically.

https://github.com/blakejakopovic/nostr-spam-detection/blob/master/labelled_nostr_events_20230225000.csv

Amazing! Thanks 😊

I’ll DM you the other couple lists I have.