I was working on an AI model that detected adult content images (and similar for text), but it affected performance on the client side (particularly when working with the image component in Damus). Doing at the relay would be good.

Reply to this note

Please Login to reply.

Discussion

I think this probably better done by other server (your server for example) to not increase the burden of relay.

You just need to send kind 1984 event after doing image analysis. Finally, this event can be used by anyone (client or relay).

https://github.com/nostr-protocol/nips/blob/master/56.md

I see content warnings as another layer or service that’s different from spam. It’s more intensive as it needs to read media and not just text. I think it could benefit the network too.

It could sit in the 1984 kind spec as a new type (I don’t think flag with content-warning it exists today). I’m uninterested in any government like ‘Net Nanny’ approach.

One difficultly is if relays broadcast these events before any flagging services have reviewed them, you have a race condition where active users will likely see the content anyway - without having a lag. Users who connect later would be fine. It’s a trade off, slowly posting to broadcasting, or less augmented protection.