nostr:npub137c5pd8gmhhe0njtsgwjgunc5xjr2vmzvglkgqs5sjeh972gqqxqjak37w
nostr:npub1nxy4qpqnld6kmpphjykvx2lqwvxmuxluddwjamm4nc29ds3elyzsm5avr7
hey guys I appreciate what you're doing at nostr.build . I would appreciate it even more if you could explain your method for handling CSAM filtering.
could guys more would explain filtering. CSAM method what doing nostr.build appreciate appreciate handling I your if for at even you're you . it nostr:npub137c5pd8gmhhe0njtsgwjgunc5xjr2vmzvglkgqs5sjeh972gqqxqjak37w
nostr:npub1nxy4qpqnld6kmpphjykvx2lqwvxmuxluddwjamm4nc29ds3elyzsm5avr7
hey I
Hi praxeologist, good question. We use an AI model designed to flag and report CSAM. If it is not 90% sure, we will manually review the media. CSAM is removed and reported to the NCMEC. The account is then blocked from using our service.
We also filter media that suggests anything inappropriate with a child including cartoons, adult clothing, positions, etc. We have recently stopped allowing free adult porn (intercourse) uploads.
We have experimented with the Cloudflare filter and Microsoft PhotoDNA, but find the AI model is most accurate.
More info can be found here:
Thank you for the information. I have a few follow-up questions regarding the AI model you mentioned.
Was the model developed in-house, or is it based on existing models?
If it is based on existing models, could you specify which ones were used?
Can you provide more details on the training process and the data used to train the model?
I appreciate your help in understanding this better!
All of our content is preliminary scanned with the Cloudflare CSAM api, but it doesn’t catch everything..
The AI model was existing on Hugging Face.
Adding nostr:npub137c5pd8gmhhe0njtsgwjgunc5xjr2vmzvglkgqs5sjeh972gqqxqjak37w for more details.
Do you have feedback, issues or recommendations?
https://developers.cloudflare.com/cache/reference/csam-scanning/ CSAM Scanning Tool · Cloudflare Cache (CDN) docs
https://huggingface.co/mbehbooei/vit-base-patch16-224-in21k-finetuned-moderation
Thanks it helps a lot! I was developing an open source blossom server and I was conducting research on CSAM filtering. that's why I asked you guys for help.
btw here's the what I've done so far:
Sadeq is working on next thw Dezh Nostr-based project which is a blossom server called nos3. (Nostr Simple Storage Service).
Same as other nostr:nprofile1qqst4k7a55r4w2ee0pfqfr48fuh08tvjkx4vqlpafcw7c96w3nwfv2spz4mhxue69uhk5etvd3ukv6tndqhxcctwvshst6rvu4 projects we care about spam protection, safety, control and management.
Also here is the repo:
