FB pixel

MIT researchers demonstrate cross-modal biometrics with facial approximation from voice

MIT researchers demonstrate cross-modal biometrics with facial approximation from voice

Researchers at MIT have developed a neural network-based model for associating vocal characteristics with facial ones to create approximate images of speakers from a short audio clip, Fast Company reports.

Speech2Face: Learning the Face Behind a Voice” goes beyond predicting age and gender from speech by including “non-negligible correlations between craniofacial features (e.g., nose structure) and voice,” the researchers write.

“We have demonstrated that our method can predict plausible faces with the facial attributes consistent with those of real images,” they conclude. “By reconstructing faces directly from this cross-modal feature space, we validate visually the existence of cross-modal biometric information postulated in previous studies.

The researchers briefly acknowledge ethical concerns that may arise from the technology, but say it could potentially be used for applications such as attaching a representative face to phone or video calls. They say the system only generalizes from common physical features, such as age and gender, rather than attempting to produce an image specific to the speaker.

Cloudflare researcher Nick Sullivan tweeted concern about the inclusion of his face and voice in the research, but Fast Company notes that voice biometrics have mostly slipped under the radar of lawmakers and regulators considering facial recognition.

Article Topics

 |   |   |   | 

Latest Biometrics News


UN says law enforcement should not use biometrics to surveil protestors

Law enforcement agencies should not use biometric technology to categorize, profile or remotely identify individuals during protests, the United Nations…


How to explain the EUDI Wallet? Industry and citizens discuss Europe’s digital ID

The European Digital Identity (EUDI) Wallet is well on its way towards becoming a reality. To explain the major impact…


Decentralize face authentication for control, stronger protection: Youverse

The implementation method of biometric face authentication has become increasingly important in recent years due to the limitations of traditional…


Researchers develop display screens with biometric sensor capabilities

Traditional display screens like those built into smartphones require extra sensors for touch control, ambient light, and fingerprint sensing. These…


Meta, porn industry and Kansas governor weigh in on age verification

As Europe mulls how to restrict access to certain content for minors, Meta offers its own solution. Meanwhile, U.S. states…


As national U.S. data privacy law becomes more likely, critics emerge to point out flaws

The push for comprehensive privacy legislation in the U.S. is gaining momentum, as the proposed American Privacy Rights Act 2024…


Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Most Read From This Week

Featured Company

Biometrics Insight, Opinion

Digital ID In-Depth

Biometrics White Papers

Biometrics Events