About-face: Amazon bars police from using Rekognition for a year
Last year, Amazon publicly challenged a researcher who found racial bias in face-recognition software. Now, it's stepping back from the technology. The tech giant said they are banning use by law enforcement for a year to allow for better regulation.
Last year, Amazon publicly challenged a researcher who found racial bias in face-recognition software. Now, it's stepping back from the technology. The tech giant said they are banning use by law enforcement for a year to allow for better regulation.
Amazon banned police use of its face-recognition technology for a year, making it the latest tech giant to step back from law-enforcement use of systems that have faced criticism for incorrectly identifying people with darker skin.
The Seattle-based company did not say why it took action now. Ongoing protests following the death of George Floyd have focused attention on racial injustice in the United States and how police use technology to track people. Mr. Floyd died May 25 after a white Minneapolis police officer pressed his knee into the handcuffed Black man鈥檚 neck for several minutes even after Mr.聽Floyd stopped moving and pleading for air.
Law enforcement agencies use facial recognition to identify suspects, but critics say it can be misused. A number of U.S. cities have banned its use by police and other government agencies, led by San Francisco last year. On Tuesday, IBM said it would聽get out聽of the facial recognition business, noting concerns about how the technology can be used for mass surveillance and racial profiling.
It鈥檚 not clear if the ban on police use includes federal law enforcement agencies. Amazon didn鈥檛 respond to questions about its announcement.
Civil rights groups and Amazon's own employees have pushed the company to stop selling its technology, called Rekognition, to government agencies, saying that it could be used to invade privacy and target people of color.
In a聽blog post聽Wednesday, Amazon said that it hoped Congress would put in place stronger regulations for facial recognition.
鈥淎mazon鈥檚 decision is an important symbolic step, but this doesn鈥檛 really change the face recognition landscape in the United States since it鈥檚 not a major player,鈥 said Clare Garvie, a researcher at Georgetown University鈥檚 Center on Privacy and Technology. Her public records research found only two U.S. agencies using or testing Rekognition.
The Orlando police department tested it, but chose not to implement it, she said. The Washington County Sheriff鈥檚 Office in Oregon has been the most public about using Rekognition, but said after Amazon鈥檚 announcement Wednesday that it was suspending its use of facial recognition indefinitely.
Studies led by MIT researcher Joy Buolamwini found racial and gender disparities in facial recognition software. Those findings spurred Microsoft and IBM to improve their systems, but irked Amazon, which last year publicly attacked her research methods. A group of artificial intelligence scholars, including a winner of computer science鈥檚 top prize, last year launched a spirited defense of her work and called on Amazon to stop selling its facial recognition software to police.
A study last year by a U.S. agency affirmed the concerns about the technology's flaws. The National Institute of Standards and Technology tested leading facial recognition systems 鈥 though not from Amazon, which didn't submit its algorithms 鈥 and found that they often performed unevenly based on a person鈥檚 race, gender, or age.
Ms. Buolamwini on Wednesday called Amazon鈥檚 announcement a 鈥渨elcomed though unexpected announcement.鈥
鈥淢icrosoft also needs to take a stand,鈥 she wrote in an emailed statement. 鈥淢ore importantly our lawmakers need to step up鈥 to rein in harmful deployments of the technologies.
Microsoft has been vocal about the need to regulate facial recognition to prevent human rights abuses but hasn鈥檛 said it wouldn鈥檛 sell it to law enforcement. The company didn't respond to a request for comment Wednesday.
Amazon began attracting attention from the American Civil Liberties Union and privacy advocates after it introduced Rekognition in 2016 and began pitching it to law enforcement. But experts like Ms. Garvie say many U.S. agencies rely on facial recognition technology built by companies that are not as well known, such as Tokyo-based NEC, Chicago-based Motorola Solutions, or the European companies Idemia, Gemalto, and Cognitec.
Amazon isn't abandoning facial recognition altogether. The company said organizations, such as those that use Rekognition to help find children who are missing or sexually exploited, will still have access to the technology.
This week's announcements by Amazon and IBM follow a push by Democratic lawmakers to pass a sweeping police reform package in Congress that could include restrictions on the use of facial recognition, especially in police body cameras. Though not commonly used in the U.S., the possibility of cameras that could monitor crowds and identify people in real time have attracted bipartisan concern.
The tech industry has fought against outright bans of facial recognition, but some companies have called for federal laws that could set guidelines for responsible use of the technology.
鈥淚t is becoming clear that the absence of consistent national rules will delay getting this valuable technology into the hands of law enforcement, slowing down investigations and making communities less safe,鈥 said Daniel Castro, vice president of the industry-backed Information Technology and Innovation Foundation, which has advocated for facial recognition providers.
脕ngel D铆az, an attorney at New York University鈥檚 Brennan Center for Justice, said he welcomed Amazon鈥檚 moratorium but said it 鈥渟hould have come sooner given numerous studies showing that the technology is racially biased.鈥
鈥淲e agree that Congress needs to act, but local communities should also be empowered to voice their concerns and decide if and how they want this technology deployed at all,鈥 he said.
This story was reported by The Associated Press.
Editor鈥檚 note: As a public service, the Monitor has removed the paywall for all our coronavirus coverage. It鈥檚 free.