Unlock instant, AI-driven research and patent intelligence for your innovation.

Unmanned aerial vehicle image real-time target detection method

A technology for target detection and drones, applied in the fields of image processing, computer vision, and pattern recognition, can solve problems such as large scale changes, unbalanced aspect ratios, narrow lengths, etc., achieve good detection accuracy and efficiency, and achieve detection accuracy and speed effect

Pending Publication Date: 2022-04-08
CHONGQING UNIV
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1) The scale changes greatly. Due to the difference in viewing angle and viewing distance, there may be a very large gap in the change of the same type of object
[0005] 2) The aspect ratio is unbalanced. Because it is observed from a high altitude, the aspect ratio of some objects to be detected is very large, that is, it is a very narrow target when viewed from the image.
[0007] Existing target detection methods based on deep learning usually have complex network models, high resource requirements, and unmanned aerial vehicle image target detection with high real-time requirements.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle image real-time target detection method
  • Unmanned aerial vehicle image real-time target detection method
  • Unmanned aerial vehicle image real-time target detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] Embodiment 1: network composition structure

[0057] see figure 1 , the target detection network structure based on strip pooling is divided into three sub-structures, namely backbone network, feature extraction network and detection head. It should be noted that the basic components of the backbone network and the feature extraction network are constructed by the improved pooling bottleneck layer. These three parts are described below.

[0058] 1. By figure 1 As shown in the left half, the backbone network follows YOLOV5's backbone network DarknetCSP, and P1-P5 are different feature layers of the backbone network. The feature layer is mainly composed of BottleneckCSP (cross-domain connection bottleneck layer) stacked. This structure consists of the classic residual structure - showing a 1x1 convolutional layer (convolution block + batch normalization + activation function), then a 3x3 convolutional layer, and finally through the residual structure with The initial...

Embodiment 2

[0064] Embodiment 2: the unmanned aerial vehicle image real-time target detection method based on strip pooling, comprises the following steps:

[0065] 1. Perform data enhancement operations on UAV images, including rotation, translation, scaling, and blending. For training, validation, and testing of object detection networks.

[0066] 2. Network model design, modification and construction, including the following three items:

[0067] 1. According to the characteristics of large scale changes, unbalanced aspect ratio, and dense distribution of the target to be detected in the UAV image, the basic network structure of YOLOV5 is improved and designed. details as follows:

[0068] The strip pooling operation is introduced to better extract the spatial information of objects in the image and obtain long-distance dependencies in one direction, so as to improve the detection accuracy of objects with unbalanced aspect ratios. Under the guidance of the idea of ​​the strip poolin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

According to the bar-pooling-based unmanned aerial vehicle image real-time target detection method provided by the invention, the bar-pooling thought is introduced, the bar-shaped bottleneck layer is designed, and basic composition modules of the backbone network and the feature extraction network are formed, so that the target detection precision of the unmanned aerial vehicle image with an unbalanced length-width ratio can be improved. A fusion mode of a feature extraction network PANet is improved into a mode of invariable spatial feature vectors, so that high-level and low-level feature information of a target is better reserved, and the method adapts to detection of an unmanned aerial vehicle image target with a large scale change; and a detection head is additionally arranged to be responsible for detection of extremely dense small targets. The above measures can significantly improve the precision of unmanned aerial vehicle image target detection. Meanwhile, on the basis of the lightweight network YOLOV5, the method is designed for the characteristics of large target scale change, unbalanced length-width ratio and dense distribution of small targets in the unmanned aerial vehicle image, so that real-time rapid detection can be realized under the condition of effectively improving the target detection precision.

Description

technical field [0001] The invention belongs to the fields of computer vision, image processing and pattern recognition. Specifically, it relates to a real-time target detection method based on UAV images. Background technique [0002] Object detection is one of the most important applications in the field of computer vision, and has been widely used in pedestrian detection, disease diagnosis, traffic tracking, and remote sensing image object detection. In recent years, due to the convenience and multi-angle characteristics of drones to obtain images, the use of images captured by drones to detect objects of interest for urban and traffic management has become an important part of smart city construction. [0003] At present, target detection methods based on deep learning have been widely used. Compared with natural images, the target detection of images obtained by UAV from high altitude has the following characteristics: [0004] 1) The scale changes greatly. Due to th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06V20/17G06V10/40G06V10/774G06V10/764G06V10/80G06V10/82G06N3/04G06N3/08
Inventor 王欣然李伟红杨利平侯俊岭张超
Owner CHONGQING UNIV