FB pixel

Microsoft working on automatic bias-detection tool for AI engineers

Categories Biometric R&D  |  Biometrics News
 

Microsoft is responding to the growing recognition that bias can be unintentionally embedded in software by developing a tool to automatically detect bias in AI algorithms, MIT Technology Review reports.

Research has demonstrated drastically differing accuracy rates for leading facial recognition algorithms when applied to different populations, and with algorithms guiding criminal sentencing and flagging individuals as potential security threats, a U.S. House subcommittee has examined the implications of the issue for government adoption of AI.

“Things like transparency, intelligibility, and explanation are new enough to the field that few of us have sufficient experience to know everything we should look for and all the ways that bias might lurk in our models,” Senior Microsoft Researcher Rich Caruna told the Review.

Caruna is part of a team building a bias-detection dashboard, though he cautions against over-reliance on policing software with software.

“Of course, we can’t expect perfection—there’s always going to be some bias undetected or that can’t be eliminated—the goal is to do as well as we can,” Caruna says. “The most important thing companies can do right now is educate their workforce so that they’re aware of the myriad ways in which bias can arise and manifest itself and create tools to make models easier to understand and bias easier to detect.”

Facebook also unveiled its Fairness Flow algorithm fairness evaluation tool at its developer conference earlier this month.

Article Topics

 |   |   |   |   | 

Latest Biometrics News

 

Biometric Update Podcast digs into deepfakes with Pindrop CEO

Deepfakes are one of the biggest issues of our age. But while video deepfakes get the most attention, audio deepfakes…

 

Know your geography for successful digital ID adoption: Trinsic

A big year for digital identity issuance, adoption and regulation has widened the opportunities for businesses around the world to…

 

UK’s digital ID trust problem now between business and government

It used to be that the UK public’s trust in the government was a barrier to the establishment of a…

 

Super-recognizers can’t help with deepfakes, but deepfakes can help with algorithms

Deepfake faces are beyond even the ability of super-recognizers to identify consistently, with some sobering implications, but also a few…

 

Age assurance regulations push sites to weigh risks and explore options for compliance

Online age assurance laws have taken effect in certain jurisdictions, prompting platforms to look carefully at what they’re liable for…

 

The future of DARPA’s quantum benchmarking initiative

DARPA started the Quantum Benchmarking Initiative (QBI) in July 2024 to expand hardware capabilities and accelerate research. In April 2025,…

Comments

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Market Analysis

Most Viewed This Week

Featured Company

Biometrics Insight, Opinion

Digital ID In-Depth

Biometrics White Papers

Biometrics Events