San Francisco has become the first US city to ban the use of facial-recognition software by city agencies and the police, dispensing a sudden shock to a major technology which is quickly being implemented by law enforcement nationwide. The 8-to-1 vote by the city's Board of Supervisors will prohibit public agencies from using the artificial-intelligence software to find the identity of someone based on a video clip or picture. Privacy and civil-rights advocates have worried that the capability could be misused for mass surveillance and possibly lead to more false arrests. The regulation will not standardize local businesses, and the technology is still essentially unregulated across the United States.
But San Francisco's ban will echo across the country mainly because of the city's identity as a friendly backyard for some of the world's most powerful tech firms, including Google and Facebook, whose engineers have designed systems that can identify and distinguish individual faces for business and consumer use.
"That a community where a lot of the folks are building facial recognition is the first to ban it is pretty telling of the dangers of the technology," said Jevan Hutson, a University of Washington law student who advocated for a facial-recognition freeze in Washington, the home state of Amazon and Microsoft. "For too long we've had this 'move fast, break things' model on the public side with surveillance," Hutson added. "We're reclaiming our ability to say no to technologies that deface democracy and our ability to live freely."
Currently, there are no federal laws to govern the use of facial recognition nationwide, and more than 50 state or local police agencies across the country have at some point used facial-recognition systems in attempts to identify criminal suspects or verify identities.
A bipartisan bill introduced in the US Senate would ban companies, but not governments, from collecting facial-recognition data without consent. The San Francisco ordinance will also require all new surveillance equipment to be approved by city leaders, who could seek measures "to verify that mandated civil rights and civil liberties safeguards have been strictly adhered to."
The Stop Secretive Surveillance ordinance is expected to be approved at an upcoming board meeting, when it will officially become law. Aaron Peskin, the San Francisco supervisor who introduced the bill earlier this year, has expressed concerns that facial-recognition technology could turn the city into a "police state." The law could heighten tensions on companies such as Amazon who have pushed for the selling of facial-recognition systems to police agencies, citing their potential benefits in finding missing children or hunting down criminals.
Amazon investors will vote next week on a proposal that could block the company from selling its system, Rekognition, to government agencies. In addition, Google has said it won't offer a general-purpose facial-recognition tool until it works through "important technology and policy questions". Microsoft has urged Congress to regulate the technology, saying companies should not be left to police themselves because of its "broad societal ramifications and potential for abuse." Members of Congress, civil-rights groups and leading artificial intelligence researchers have called on Amazon and other companies to stop developing the technology for law-enforcement use.
Studies have found that the systems lack accuracy when used on minorities, raising the risks of misidentification. But the San Francisco law may not slow the growth of facial-recognition technology in schools, sporting arenas and airports, which have folded them into their gated areas for an additional layer of identify verification and surveillance. The Department of Homeland Security said last month that it wanted 97 percent of all departing air travelers to undergo a facial-recognition scan by 2023.