Unlock instant, AI-driven research and patent intelligence for your innovation.

Road defect detection method based on deep learning and self-attention mechanism

A technology of defect detection and deep learning, applied in neural learning methods, mechanical equipment, combustion engines, etc., can solve the problems of low detection accuracy, achieve the effect of improving the average accuracy rate and improving the fusion effect

Pending Publication Date: 2022-06-07
XI AN JIAOTONG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current target detection algorithms usually have a better detection effect on targets with regular outlines and fixed sizes. When facing road defect targets such as cracks and potholes, the detection accuracy is often low due to factors such as various sizes and irregular shapes. Therefore, it is particularly important to construct a suitable detection network model for such targets.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Road defect detection method based on deep learning and self-attention mechanism
  • Road defect detection method based on deep learning and self-attention mechanism
  • Road defect detection method based on deep learning and self-attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The specific details of each step of the present invention will be described in detail below with reference to the accompanying drawings.

[0029] The present invention proposes a road defect detection method based on deep learning and self-attention mechanism. The whole process of the method is as follows: figure 1 shown.

[0030] The method mainly includes the following steps:

[0031] Step A: Select public datasets containing longitudinal cracks, transverse cracks, mesh cracks, and pits, and divide the dataset into training, validation, and test sets.

[0032] Step B: Build a road defect detection neural network model. The final output of the network is the predicted defect category and location on the image. The structure of the road defect detection neural network model is as follows: figure 2 shown.

[0033] The specific steps of the step B are as follows:

[0034] Step B01: The road defect detection neural network model uses the DarkNet53 network as the back...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a road defect detection method based on deep learning and a self-attention mechanism, and the method comprises the steps: 1, selecting an open road defect data set containing longitudinal cracks, transverse cracks, net cracks and pits, and dividing a training set, a verification set and a test set; 2, building a road defect detection neural network model based on a single-stage target detection method, wherein the final output of the network is the defect category and position predicted on the image; 3, training the road defect detection neural network model by using the training set to obtain a road defect detection model; and 4, for an input road image, adopting the road defect detection model to obtain a plurality of detection results, filtering the repeated detection results by using a non-maximum suppression algorithm, and finally obtaining the category and position of the road defect in the image. Based on a self-attention mechanism, the road defect detection precision is improved through fusion of feature maps in different stages, and the problem that the average detection accuracy is affected by large road defect size and shape changes is solved.

Description

technical field [0001] The invention belongs to the application field of computer vision, in particular to a road defect detection method based on deep learning and self-attention mechanism. Background technique [0002] At present, the daily inspection of urban roads mainly relies on inspectors to patrol the roads. For the road defects found, they are reported by manual operations such as filling out newspaper quality forms, which are inefficient. In addition, this method is highly subjective, and it is difficult for different inspectors to maintain a consistent perception of the degree of the same defect. In addition, the length of roads inspected by inspectors every day is generally between 30-40km, and the mileage is short. Therefore, the use of computer technology to intelligently analyze road surface defects has important practical significance. Existing technical means generally use road survey vehicles equipped with many sensors to conduct road surface condition su...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/00G06N3/04G06N3/08G06K9/62G06V10/764G06V10/774G06V10/80G06V10/82
CPCG06T7/0002G06N3/08G06T2207/20081G06T2207/20084G06T2207/30184G06N3/045G06F18/24G06F18/253G06F18/214Y02T10/40
Inventor 张雪涛郑博涵聂明显张奇
Owner XI AN JIAOTONG UNIV