Amazon's Deep Learning Service Rekognition Mistakes Congress Members For Criminals

Perhaps it needs more time in the oven. 

5

Amazon's Rekognition service has been making a considerable amount of mistakes, it seems, and its latest set may be some of the most egregious. Recently, the American Civil Liberties Union reported that during a recent test, the service mistakenly identified 28 members of Congress as criminals.

Previously, the ACLU took a collection of a whopping 25,000 mugshots from an unnamed "public source" and had the service compare them all the photos from Congress. There were various photos simply misidentified, including civil rights activist Rep. John Lewis (D-Goergia). In fact, many of the false matches, around 38 percent of them to be exact, were actually people of color.

An Amazon spokesperson told VentureBeat that the test likely made these egregious mistakes because of some "poor calibration" due to the low "confidence threshold" utilized by the system.

“While 80 percent confidence is an acceptable threshold for photos of hot dogs, chairs, animals, or other social media use cases, it wouldn’t be appropriate for identifying individuals with a reasonable level of certainty.”

Previously, Amazon shareholders rallied together to address a letter to Amazon CEO Jeff Bezos regarding concerns over Rekognition being sold to law enforcement agencies.

“We are concerned the technology would be used to unfairly and disproportionately target and surveil people of color, immigrants, and civil society organizations … We are concerned sales may be expanded to foreign governments, including authoritarian regimes," read the letter.

If any kind of tech like this is planned to be implemented in the future, it sounds like it'll have to go through a particularly extensive metamorphosis first, indeed.

Senior Editor

Fueled by horror, rainbow-sugar-pixel-rushes, and video games, Brittany is a Senior Editor at Shacknews who thrives on surrealism and ultraviolence. Follow her on Twitter @MolotovCupcake and check out her portfolio for more. Like a fabulous shooter once said, get psyched!

From The Chatty