Unmanned aerial vehicle tunnel defect detection method and system

A defect detection and UAV technology, applied in radio wave measurement systems, neural learning methods, unmanned aircraft, etc., can solve the problems that cannot meet the requirements of tunnel defect detection, UAV positioning error, weak light, etc.

Pending Publication Date: 2021-09-07
TONGJI UNIV
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when performing tunnel defect detection, due to the weak light in the tunnel, and even dark areas, the collected images are often of low quality
Moreover, GPS technology cannot be used in the tunnel, and the positioning error of the UAV continues to accumulate over time. Since the tunnel is a highly symmetrical structure, there are almost no other geometric features and textures, which also gives the UAV position in multiple degrees of freedom. pose estimation poses challenges
Due to insufficient positioning accuracy, after the tunnel defect is found based on the image, the returned position information also has a large error
Therefore, the existing technology cannot meet the requirements of tunnel defect detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle tunnel defect detection method and system
  • Unmanned aerial vehicle tunnel defect detection method and system
  • Unmanned aerial vehicle tunnel defect detection method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] In this embodiment, the unmanned aerial vehicle for tunnel defect detection is a multi-rotor unmanned aerial vehicle, which is equipped with LED modules, cameras, laser radars, ultrasonic range finders and inertial measurement device IMUs. Illumination enables the camera to collect images at a certain brightness. The radar point cloud data collected by the lidar can realize the positioning and obstacle avoidance of the drone. The camera collects tunnel images for defect detection and can be used as a visual odometer to estimate The attitude information of the UAV, and the ultrasonic rangefinder is used to obtain the height information of the UAV.

[0040] A method for detecting defects in unmanned aerial vehicle tunnels, such as figure 1 shown, including the following steps:

[0041] S1. The UAV is equipped with an LED module and a camera, based on the LED module and the camera, multiple original images of tunnel defects are collected in the tunnel to obtain an origina...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an unmanned aerial vehicle tunnel defect detection method and system, an unmanned aerial vehicle carries an LED module, a camera, a laser radar, an ultrasonic range finder and an IMU, and the method comprises the following steps: collecting images in a tunnel based on the LED module and the camera to obtain a training image set; training by using the training image set to obtain a defect detection model; collecting real-time tunnel images, performing suspected defect detection on the real-time tunnel images through the defect detection model, obtaining unmanned aerial vehicle pose information based on the camera, the laser radar, the ultrasonic range finder and the IMU, and controlling the unmanned aerial vehicle to hover. Compared with the prior art, the LED module is used for supplementing illumination in the tunnel, the IMU, the camera, the laser radar and the ultrasonic range finder are fused to achieve unmanned aerial vehicle pose estimation, the trained defect detection model is used for detecting whether suspected defects exist or not in real time, hovering is carried out after the suspected defects are found, and defect detection is further carried out. Accurate pose estimation and defect detection can be realized in a tunnel which has no GPS signal and is highly symmetrical inside.

Description

technical field [0001] The invention relates to the field of unmanned aerial vehicle inspection, in particular to a method and system for detecting defects in an unmanned aerial vehicle tunnel. Background technique [0002] In recent years, my country's infrastructure facilities, such as underground subway tunnels, railway tunnels and high-speed tunnels, have entered an "aging" period after long-term use, requiring regular maintenance and inspection, otherwise it will cause disastrous consequences. However, traditional maintenance requires a lot of manpower and material resources, and there are problems such as heavy workload, high risk factor, and harsh working environment. Therefore, it is urgent to use drones for facility maintenance. UAVs are flexible, agile, and can easily reach places that humans cannot reach. [0003] In the existing technology, the UAV flies autonomously during the inspection process, uses GPS signals for positioning, and updates the location inform...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G01N21/95G01N21/88G01S15/08G01S15/86G01S15/93G01S17/86G01S17/933G01C21/16G06N3/08G06T5/00G06T7/00G06T7/70B64C39/02
CPCG01N21/9515G01N21/8851G01C21/1652G01C21/1656G01S15/08G01S15/86G01S15/93G01S17/86G01S17/933G06T7/0004G06T7/70G06N3/08B64C39/02G01N2021/9518G01N2021/8887G01N2021/8854G06T2207/20081B64U2101/00G06T5/70G05D1/0094G01M5/0075G01M5/0033G01M5/0091G06T2207/30132G06T2207/20084G06T2207/10032G01N21/954G01N2021/9544G01N2201/1296G05D1/101G06T7/20G06T5/92
Inventor 何斌王旭东沈润杰陈杰李刚王志鹏朱忠攀
Owner TONGJI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products