An AI-powered gun detection system deployed in Baltimore County schools misidentified a teenager's empty Doritos bag as a firearm, triggering an armed police response that resulted in the student being handcuffed. Despite the false positive, the vendor Omnilert defended the system as operating as designed, highlighting critical challenges in computer vision accuracy and the risks of deploying immature AI systems in high-stakes security contexts.

2m read timeFrom aidarwinawards.org
Post cover image
Table of contents
The InnovationThe CatastropheThe Corporate LogicWhy They're Nominated
1 Comment

Sort: