FB pixel

MIT researchers developing automated tool to ‘de-bias’ AI training data

Categories Biometric R&D  |  Biometrics News
 

A team at MIT’s Computer Science & Artificial Intelligence Lab (CSAIL) is developing a solution which features an algorithm that can automatically ‘de-bias’ data by resampling it to improve its balance, according to an announcement.

The algorithm can identify and minimize hidden biases by learning both a specific task, such as face detection, and the underlying structure of the training data. It was 60 percent effective in decreasing ‘categorical bias’ compared to state-of-the-art facial detection models, in testing on the same Gender Shades facial image data set developed last year by MIT Media Lab researchers, according to the announcement. The algorithm can also be applied to other AI applications.

A significant difference between the solution in development and many existing approaches to the field is that it is entirely automated, and does not require human input to define the bias being targeted. This makes it potentially of particular use for larger data sets.

“Facial classification in particular is a technology that’s often seen as ‘solved,’ even as it’s become clear that the datasets being used often aren’t properly vetted,” says PhD student Alexander Amini. “Rectifying these issues is especially important as we start to see these kinds of algorithms being used in security, law enforcement and other domains.”

Amini and PhD student Ava Soleimany co-wrote the paper describing the system with graduate student Wilko Schwarting and MIT professors Sangeeta Bhatia and Daniela Rus, and Amini was co-lead author on a related paper that was presented this week at the Conference on Artificial Intelligence, Ethics and Society (AIES).

IBM has launched a data set architected to yield insights into the science behind bias, such as what constitutes sufficient diversity.

Article Topics

 |   |   |   |   |   |   | 

Latest Biometrics News

 

Findynet funding development of six digital wallet solutions

Finnish public-private cooperative Findynet has announced it will award 60,000 euros (US$69,200) to six digital wallet vendors to help translate…

 

Patchwork of age check, online safety legislation grows across US

As the U.S. waits for the Supreme Court’s opinion on the Texas case of Paxton v. Free Speech Coalition, which…

 

AVPA laud findings from age assurance tech trial

The Age Verification Providers Association (AVPA), and several of its members, have welcomed the publication of preliminary findings from the…

 

Sri Lanka to launch govt API policies and guidelines

Sri Lanka’s government, in the wake of its digital economy drive, is gearing up to release application programming interface (API)…

 

Netherlands’ asylum seeker ID cards from Idemia use vertical ICAO format

The Netherlands will introduce new identity documents for asylum seekers Idemia Smart Identity, compliant with the ICAO specification for vertical…

 

Zenoo integrates Trinsic, Sumsub for advanced digital ID onboarding options

Onboarding and compliance orchestration engine provider Zenoo has formed a pair of partnerships to give its customers a broader range…

Comments

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Biometric Market Analysis

Most Viewed This Week

Featured Company

Biometrics Insight, Opinion

Digital ID In-Depth

Biometrics White Papers

Biometrics Events