FB pixel

Algorithmic Justice League highlights automatic speech recognition bias report

Algorithmic Justice League highlights automatic speech recognition bias report
 

The Algorithmic Justice League has released a spoken word and visual project called “Voicing Erasure” to protest the demographic discrepancies or “bias” identified in popular speech recognition systems on the market, following its recent study of algorithmic bias, AI, and technology, writes VentureBeat.

The Algorithmic Justice League was started by MIT researcher Joy Buolamwini. Results of the research led by the group were outlined in the report “Racial disparities in automated speech recognition”, which was published last week in the Proceedings of the National Academy of Sciences.

The written report highlights how automatic speech recognition systems developed by Apple, Amazon, Google, IBM, and Microsoft together have a higher word error rate for African-American voices (35 percent) compared to white voices (19 percent).

Each system tested transcribed 20 hours of recordings of 42 white speakers and 73 African-American speakers. The group used voice data from Humboldt County and Sacramento, California, and focused on African-American Vernacular English (AAVE). The reason behind the bias is likely the lack of audio data containing African-American speakers, which is why the researchers emphasized the importance of investments in inclusivity.

“Such an effort, we believe, should entail not only better collection of data on AAVE speech but also better collection of data on other nonstandard varieties of English, whose speakers may similarly be burdened by poor ASR performance — including those with regional and nonnative-English accents,” the report reads. “We also believe developers of speech recognition tools in industry and academia should regularly assess and publicly report their progress along this dimension.”

The visual project was put together by seven women, including former White House CTO Megan Smith, Race After Technology author Ruha Benjamin, Design Justice author Sasha Costanza-Chock, and Kimberlé Crenshaw, law professor at Columbia Law School and UCLA. The project notes that the New York Times coverage of the bias report cites male experts, but not the report’s lead author, Allison Koenecke.

Buolamwini and a number of research partners investigated, between 2018 and 2019, racial differences and imbalance in how popular facial recognition and analysis systems performed. The team conducted a number of audits on facial recognition bias, which are now often referenced by lawmakers and activists.

Google and IBM Watson have committed to solving this problem in their systems.

Article Topics

 |   |   |   |   |   |   |   | 

Latest Biometrics News

 

NDPC urges Africa-wide data protection, signs MoU with Somalia and launches privacy academy

It’s a busy month for Nigeria and African data protection officials as Nigeria’s capital Abuja hosted an annual conference, which…

 

10 million passkeys registered for Mercari market app amid phishing crisis

Mercari, the Japanese e-commerce company behind the Mercari marketplace, has surpassed 10 million registered users of passkeys for authentication. A…

 

Project NOLA’s facial recognition push raises legal and civil rights questions

This week, the New Orleans City Council’s Criminal Justice Committee is expected to convene a hearing to address concerns about…

 

PNG launches birth registration legislation in landmark for national ID project

Papua New Guinea is taking a concrete step in making sure every citizen is officially recognized and able to access…

 

Yoti improves liveness detection pass rates

Digital identity and age estimation company Yoti has released new figures on its liveness detection technology, showing success rate improvements…

 

Inclusive digital ID poised for leap forward with QR codes, similar credentials

QR codes have been around for decades, but they and other similar technologies have only recently emerged as digital identity…

Comments

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Biometric Market Analysis

Most Viewed This Week

Featured Company

Biometrics Insight, Opinion

Digital ID In-Depth

Biometrics White Papers

Biometrics Events