OK nerdstr:

How do I take surveillance system video streams and feed them into locally hosted AI to detect and identify different types of wildlife, humans, vehicles, etc?

Reply to this note

Please Login to reply.

Discussion

https://opencv.org/ could be useful

I would think you’d need a full-size server rack filled to the brim with top-of-the-line Nvidia GPUs.

I've been looking at this, and ZoneMinder or Frigate seem to be a starting point.

ZoneMinder appears to be ok but not perfect. I've seen a bunch of flowers being mistaken for a cat at a higher confidence than the actual kid as a human.

Any time with Frigate? I'm still fooling with ZM and learning how things communicate, etc. Frigate looked simpler/easier at first glance.

I only shared an anecdote of a ZM user. Haven't used it myself but the anecdote was very recent.

I used zoneminder around 8 years ago and really hated it. 😬

Yeah, that does seem to be common. Those are the only two I've run across that are FOSS-ish and user-friendly-ish. I figure as I learn them I'll find something better or easier. It's always a slog.

Unifi has some of this, but not open source afiak.

Frigate is it

Came here to say this. Best of the options.

LAN only Unifi NVR. Not open sauce but does the job.

Can you grab the stream via USB? Use some model like imagenet and feed it frame by frame

OpenCV for this as a basis. there is also OpenCV-Python, but you need to know how to use numpy, i used to use this to do image detection experiments faster

I use Frigate.

you can use a HDMI to Ethernet adapter. it takes the video and turn it into a mpeg stream

OpenCV

Since no one mentioned it, yolo might be the easiest AI model to use for this: https://github.com/ultralytics/ultralytics