High-speed rail fastener defect identification method based on heterogeneous image fusion

Abstract

The invention relates to a high-speed rail fastener defect identification method based on heterogeneous image fusion, and belongs to the technical field of machine vision detection. The method comprises the following steps: S1, synchronously and dynamically acquiring a two-dimensional gray image G(x, y) of a high-speed rail fastener area and a two-dimensional depth image D(x, y) of a rail; S2, registering the two-dimensional grayscale image G(x, y) and the two-dimensional depth image D(x, y) to enable the two-dimensional grayscale image G(x, y) and the two-dimensional depth image D(x, y) to accurately correspond to the same position in the scene; S3, respectively carrying out feature extraction on the two-dimensional grayscale image G(x, y) and the two-dimensional depth image D(x, y) of the fastener area after registration; S4, performing feature mapping on features extracted from the two-dimensional grayscale image G(x, y) and the two-dimensional depth image based on metric learning,and fusing the mapped features; S5, inputting the fused features into an SVM classifier to realize classification of the fasteners. According to the invention, the defect detection rate of the fastener is improved, the omission ratio of the defective fastener is lower, the practicability is strong, and the method is worth popularizing.

Description

technical field [0001] The invention belongs to the technical field of machine vision detection, and in particular relates to a high-speed rail fastener defect recognition method based on heterogeneous image fusion. Background technique [0002] Railways are the main artery of the national economy, key infrastructure and major livelihood projects, and the backbone of the comprehensive transportation system. The infrastructure of the railway includes rails, fasteners, sleepers and fishplates, etc. The fasteners connect the rails and sleepers, and the fasteners on the left and right sides of the rail fix the rails on the sleepers to prevent them from shifting. With the development of railways in the direction of high speed, high density and heavy load, the destructive power of trains on railway infrastructure has increased, such as rail cracks, wear and fastener function failure. The failure of the fastener function is mainly manifested in the absence of the fastener, the buc...

AI Technical Summary

Problems solved by technology

[0006] (1) The two-dimensional image collected by two-dimensional visual imaging lacks the depth information of the third dimension, and it is difficult to detect whether the fastener is loose, resulting in missed and false detection of defects;

[0007] (2) The point cloud or depth map obtained by 3D visual imaging loses the scene color and texture information, and it is difficult to accurately detect whether the fastener is lost, broken or out of place, so that some types of defective fasteners are missed.

Images