I guess that flagging and filtering out images is very expensive, because you need to use classic or ML based computer vision models. I cannot think to a cheaper way to do it. Plus, training a CNN to filter CSAM material means collecting such a dataset and training it. Training it means putting the images on a training environment...probably AWS or others, which would put you in a dangerous position...

Something may already exist out there, but certainly that is more complex than just filtering text.

LLMs are not the best tool for that probably

Reply to this note

Please Login to reply.

Discussion

thanks. perhaps a simple blacklist service NIP could help. one that just stores the media and note references as text

That is a start, yes. Somewhere someone still have to recognize the malevolent content btw. Plus, if I set up script that loads into a relay thousands of copies of the same pic, every pic will have a different note reference, thus filters would have to store a large amount of note references for one pic.

Probably flagging accounts is way easier

I'd ideally like 2 settings to: 1)filter notes and direct media refs, and 2) also mute accounts as 2nd option. #dreams