have you considered volunteer moderators? how would that play out if it’s possible?
We take this very seriously using a combination of AI, Cloudflare and manual filters. If anything is found it is immediately removed, the user’s acct is blocked from us, and all evidence reported to NCMEC.
We also provide moderation headers that classifies adult and violent content, I believe nostr:npub1xtscya34g58tk0z605fvr788k263gsu6cy9x0mhnm87echrgufzsevkk5s is planning to implement. This would help if something temporarily slips by.
nostr:npub12vkcxr0luzwp8e673v29eqjhrr7p9vqq8asav85swaepclllj09sylpugg is adding us as a media host over the next couple of months. I will make sure we bring up this type of csam moderation so they can apply it to their service.
Discussion
We have, and at one time had volunteers helping, but didn’t work out so well because most didn’t do anything after a while, and also we didn’t want to be liable for their mental trauma.. I don’t want to out that on anyone..
The AI model we use works pretty well for now. We also use a service called PhotoDNA that works well.