It's fascinating that there are lightweight models that can achieve 'real time' or at least 'near real time' under 100ms.
One of those models is from detoxify (unbiased-small) which achieves evaluation score of 93.74 (Top Performer score: 94.73).
Discussion
In other domain, there are also lightweight models such as MobileNet and EfficientNet for Image Classification, YOLO for Visual Object Detection.
Hopefully more AI research in computer science will be focused on building 'lightweight yet powerful' model thus edge devices (Mobile Phone, Limited CPU only device) can get big benefit using those models for AI applications. 🤗
Currently continuing development of nostr-filter-relay. WIP for several features. 😅
