I worked for a startup that involved using facial recognition to solve crimes. I witnessed our model making mistakes live several times.

The executives thought it was awesome and kept doing demos of it for clients, and pressured me to add my photo to the database so I could demo it too.

I refused, and sadly the experience poisoned my attitude towards machine learning and AI for years.

During the pandemic, some undercover loss prevention agents stopped my wife at our local grocery store. They tend to focus on women of certain races pushing strollers, but this time it was their algo that told them to stop her.

The algo misfired and flagged her as not paying. She had a receipt, luckily she had listened to my rants and told them to fuck off as she showed them her receipt and she walked out. One of the agents claimed their system had never made that mistake before.

This shit is real and it’s coming. nostr:note1huxve7y0vq9krw2lj7dnse52lrszmgllxq6t0fxt8s62g9k2utdsfcre9x