Hardware surface defect online detection method based on multi-modal sensing fusion

By employing a multimodal sensor fusion method, combining optical cameras, line laser scanners, and thermal imaging cameras, efficient and reliable detection of surface defects in hardware parts has been achieved. This addresses the limitations of single sensors in complex environments and improves detection accuracy and adaptability.

CN121746286AInactive Publication Date: 2026-03-27DONGGUAN DONGJIHUA HARDWARE ELECTRONIC TECHNOLOGY CO LTD
0 Cites 4 Cited by

Patent Information

Application Number
CN202511592059.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-11-03
Publication Date
2026-03-27
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing methods for detecting surface defects in hardware parts rely on a single sensor, which suffers from problems such as high reflectivity, interference from complex textures, low optical image contrast, and large variations in ambient lighting. This results in insufficient detection accuracy and robustness, and the lack of an adaptive mechanism makes it impossible to adapt to changes in different hardware parts types and production conditions.

Method used

A multimodal sensor fusion method is adopted, including a high-resolution optical camera, a line laser scanner and a thermal imaging camera. Color image data, 3D point cloud data and temperature distribution data are acquired through synchronous triggers. Reliability assessment and adaptive weighted fusion are performed by combining fuzzy logic method, and defect classification and localization are performed by support vector machine classifier.

Benefits of technology

It improves the accuracy and robustness of surface defect detection for hardware parts, can efficiently identify minute defects under different lighting conditions, adapts to complex production environments, reduces false detections and missed detections, and improves the overall efficiency and adaptability of the production line.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the technical field of surface defect detection, in particular to a hardware surface defect online detection method based on multi-modal sensing fusion, which comprises the following steps: step 1, arranging multi-modal sensor groups above and on the side of a conveyor belt of a hardware production line; 2, preprocessing the multi-modal sensor data acquired in the step 1; 3, extracting features from the multi-modal sensor data preprocessed in the step 2; 4, performing reliability evaluation on the multi-modal features extracted in the step 3; 5, generating a fusion feature vector, wherein adaptive weighted fusion adopts a weighted feature splicing method; and step 6, outputting defect types and position information to a production line control system. The combined use of the multi-modal sensor can comprehensively detect the surface of the hardware from multiple dimensions, and the accuracy and stability of the system are further improved through reliability evaluation and weighted fusion.
Need to check novelty before this filing date? Find Prior Art