FB pixel

Researchers claim improved small object detection with multi-modal 3D network

Researchers claim improved small object detection with multi-modal 3D network

A team of academic researchers has developed the Dynamic Point-Pixel Feature Alignment network, known as DPPFA-Net, to address the issue of accurately detecting small objects for robots and autonomous vehicles. When compared to other existing 3D object detection methods, this model demonstrated a significant improvement in average precision, achieving a 7.18 percent increase across various noise conditions.

Auto makers have been adding face biometrics to vehicles like the Genesis GV60 for door unlocking, even as smart automobile developers stake different positions on the kinds of optical sensors they need to meet the computer vision requirements of autonomous vehicles. A consensus on what kinds of cameras are needed for other applications may determine the imaging systems biometrics developers have to work with.

Despite the growing demand for autonomous vehicles and robotic automation solutions, object detection remains a complex task within AI workload. A critical aspect of this challenge involves the use of LiDAR sensors, which generate 3D point clouds that offer depth information about the surrounding environment. However, the LiDAR data is susceptible to noise, potentially causing errors in object detection.

To address this issue, a team led by Professor Hiroyuki Tomiyama from Ritsumeikan University in Japan has introduced a multi-modal 3D object detection approach that combines 3D LiDAR data with 2D RBG images captured by standard cameras. The research emphasizes the significance it holds in the field of robotics, as it enables robots to gain a better understanding of and adapt to their environment.

“Our study could facilitate a better understanding and adaptation of robots to their working environments, allowing a more precise perception of small targets,” explains Tomiyama. “Such advancements will help improve the capabilities of robots in various applications.”

The proposed system comprises several modules: a memory-based point-pixel fusion module (MPPF), a deformable point-pixel fusion module (DPPF), and a semantic alignment evaluator (SAE) module. These various specialized modules are integrated to enhance the accuracy and robustness of object detection in complex scenarios characterized by potential environmental noise.

The memory-based point-pixel fusion module facilitates the interaction among features within the same modality as well as across different modalities. The module utilizes 2D images as a memory bank, enabling the network to learn and adapt to noise in 3D point cloud data. In contrast, the deformable point-pixel fusion module focuses on interactions at specific pixel positions, maintaining high resolution while keeping computational complexity low.

“The DPPF module establishes interactions exclusively with key position pixels based on a sampling strategy. This design not only guarantees a low computational complexity but also enables adaptive fusion functionality, especially beneficial for high-resolution images. The SAE module guarantees semantic alignment of the fused features, thereby enhancing the robustness and reliability of the fusion process,” the researchers explain.

During the evaluation of the Dynamic Point-Pixel Feature Alignment network, the research team introduced artificial multi-modal noise into the KITTI dataset. According to the study’s findings, the proposed network stands out as one of the most advanced and accurate 3D object detection methods available.

Article Topics

 |   |   |   |   | 

Latest Biometrics News


Biometrics deployments expand protection against fraud and lying about your age

Biometrics are protecting against false claims of all sorts in several of the most-read articles of the past week on…


UN says law enforcement should not use biometrics to surveil protestors

Law enforcement agencies should not use biometric technology to categorize, profile or remotely identify individuals during protests, the United Nations…


How to explain the EUDI Wallet? Industry and citizens discuss Europe’s digital ID

The European Digital Identity (EUDI) Wallet is well on its way towards becoming a reality. To explain the major impact…


Decentralize face authentication for control, stronger protection: Youverse

The implementation method of biometric face authentication has become increasingly important in recent years due to the limitations of traditional…


Researchers develop display screens with biometric sensor capabilities

Traditional display screens like those built into smartphones require extra sensors for touch control, ambient light, and fingerprint sensing. These…


Meta, porn industry and Kansas governor weigh in on age verification

As Europe mulls how to restrict access to certain content for minors, Meta offers its own solution. Meanwhile, U.S. states…


Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Most Read From This Week

Featured Company

Biometrics Insight, Opinion

Digital ID In-Depth

Biometrics White Papers

Biometrics Events