FB pixel

Microsoft working on automatic bias-detection tool for AI engineers

Categories Biometric R&D  |  Biometrics News
 

Microsoft is responding to the growing recognition that bias can be unintentionally embedded in software by developing a tool to automatically detect bias in AI algorithms, MIT Technology Review reports.

Research has demonstrated drastically differing accuracy rates for leading facial recognition algorithms when applied to different populations, and with algorithms guiding criminal sentencing and flagging individuals as potential security threats, a U.S. House subcommittee has examined the implications of the issue for government adoption of AI.

“Things like transparency, intelligibility, and explanation are new enough to the field that few of us have sufficient experience to know everything we should look for and all the ways that bias might lurk in our models,” Senior Microsoft Researcher Rich Caruna told the Review.

Caruna is part of a team building a bias-detection dashboard, though he cautions against over-reliance on policing software with software.

“Of course, we can’t expect perfection—there’s always going to be some bias undetected or that can’t be eliminated—the goal is to do as well as we can,” Caruna says. “The most important thing companies can do right now is educate their workforce so that they’re aware of the myriad ways in which bias can arise and manifest itself and create tools to make models easier to understand and bias easier to detect.”

Facebook also unveiled its Fairness Flow algorithm fairness evaluation tool at its developer conference earlier this month.

Article Topics

 |   |   |   |   | 

Latest Biometrics News

 

Move over, Armani: Italy’s It Wallet is the digital ID accessory of the season

Bravo to Italy for the forthcoming launch of its digital wallet scheme, clearing the path for a national digital identity…

 

Sumsub brings non-doc biometric identity verification to new markets

Biometric identity verification providers are expanding their market reach in various ways, including Sumsub’s support for users without ID documents…

 

Scottish Government emphasizes security of new platform for digital public services

Scotland is talking up the data security measures designed and build into ScotAccount, a single-sign on (SSO) service designed to…

 

Zambia, Namibia, Tanzania upgrade digital ID systems in concert with development partners

Zambia has carried out a major first step in its transition towards a modern legal and digital identity system, by…

 

Bermuda delays facial recognition deployment for national CCTV project

Bermuda’s government will not be deploying facial recognition capabilities in its CCTV system, at least for now, due to unspecified…

 

Florida Police deploy Idemia ABIS for latent fingerprint biometric analysis

Idemia Public Security North America has announced the implementation of its automated biometric identification system, Storm ABIS, by forensics examiners…

Comments

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Most Read This Week

Featured Company

Biometrics Insight, Opinion

Digital ID In-Depth

Biometrics White Papers

Biometrics Events