Unlock instant, AI-driven research and patent intelligence for your innovation.

Steel rail surface defect image expansion method based on attention mechanism and DCGAN

An attention and defect technology, applied in the field of rail surface defect detection, can solve the problems of poor performance, low sample diversity, and it is difficult for the algorithm to detect the untrained, so as to increase the diversity and improve the application effect.

Pending Publication Date: 2022-08-02
LANZHOU JIAOTONG UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, supervised learning needs to train a large number of defect samples. Due to timely maintenance, there are few defect samples in the track inspection images obtained from the railway engineering department, so that supervised deep learning such as target detection and semantic segmentation does not perform well in actual scenarios. At the same time, there are many defects. Scale and diversity bring challenges to detection tasks
Currently commonly used data augmentation methods such as rotation, cropping, and adding noise essentially only increase the number of data sets, and the diversity of defect samples generated by the generative confrontation network GAN is low, making it difficult for the algorithm to detect untrained defects.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Steel rail surface defect image expansion method based on attention mechanism and DCGAN
  • Steel rail surface defect image expansion method based on attention mechanism and DCGAN
  • Steel rail surface defect image expansion method based on attention mechanism and DCGAN

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] An image augmentation method for rail surface defects based on attention mechanism and DCGAN, characterized in that it includes the following steps:

[0060] S1. Create a track surface defect dataset, including the following steps:

[0061] S11. Select images: select no less than 200 photos of rail surface defects;

[0062] S12. Crop the picture: crop out the surface area of ​​the rail containing the defect, and adjust the size to 300×130.

[0063] 2. Build a self-attention module, including the following steps:

[0064] S21. Perform linear transformation and channel adjustment on the feature map x in the hidden layer through 1×1 convolution and convert it into 3 feature maps f(x), g(x), h(x), where f(x), g (x) used to calculate attention;

[0065] S22. Transpose the output of f(x) and multiply it with the output of g(x), and normalize by softmax to obtain the attention map M(x);

[0066] S23. Multiply the attention map M(x) and the linearly transformed original fea...

Embodiment 2

[0098] An image augmentation method for rail surface defects based on attention mechanism and DCGAN, characterized in that it includes the following steps:

[0099] 1) Make a rail surface defect data set, select no less than 200 rail surface defect photos, cut out the rail surface area containing the defects, and adjust the size to 300×130.

[0100] 2) Build a self-attention module, calculate the relationship between any two pixels in the image, and capture the internal correlation of features, such as figure 1 shown. The specific process of building a self-attention module is as follows:

[0101] 21) Perform linear transformation and channel adjustment on the feature map x in the hidden layer by 1×1 convolution and convert it into 3 feature maps f(x), g(x), h(x), where f(x), g (x) used to calculate attention;

[0102] 22) Transpose the output of f(x) and multiply it with the output of g(x), and normalize by softmax to get the attention map M(x);

[0103] 23) Multiply the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of steel rail surface defect detection, in particular to a steel rail surface defect image expansion method based on an attention mechanism and DCGAN, comprising the following steps: making a rail surface defect data set; building a self-attention module; building a channel attention module; building a DCGAN network and adding self attention and channel attention; training the model and obtaining a generation result; the method has the beneficial effects that the depth of the DCGAN is properly increased, a self-attention mechanism is added to capture the long-distance size dependence in the image, and the defect that convolution can only process local neighborhood information is overcome; and a channel attention mechanism is added to recalibrate features of a convolution channel interdependence relationship, and more important channel information is paid attention to. The rail surface defect samples generated by the method are good, many new defects are generated on the basis of the original data set, the diversity of the defects is increased, the method can be used for large-scale expansion of the rail surface defect samples, and application of supervised deep learning to steel rail detection is improved.

Description

technical field [0001] The invention relates to the technical field of rail surface defect detection, in particular to a rail surface defect image expansion method based on an attention mechanism and DCGAN. Background technique [0002] During train operation, the wheel hub and the rail have long-term contact friction and impact, and the defects of the rail mostly start from the surface and gradually increase. When the train runs on the surface of the defective track, the periodic impact will cause the coupled vibration of the entire vehicle and the rail system. Running under the environment of extreme conditions will shorten the service life of each part of the train, and in severe cases, it will cause the vehicle to be overturned, burned and cut. Therefore, it is of practical significance to detect track surface defects in time. Physical detection methods such as eddy current detection and magnetic flux leakage detection were once the main means of rail detection, but thei...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/774G06K9/62G06T7/00G06N3/04G06N3/08
CPCG06T7/0004G06N3/08G06N3/045G06F18/214
Inventor 闵永智李嘉峰王果张振海张雁鹏张鑫林俊亭左静岳彪
Owner LANZHOU JIAOTONG UNIV