A small target detection method based on an unmanned aerial vehicle

A technology for small target detection and unmanned aerial vehicles. It is applied in the field of online target detection and unmanned aerial vehicles. It can solve the problems of noise and light sensitivity, small size, multi-layer nonlinear processing, high computing and hardware costs, and reduce labor costs. , the effect of improving the accuracy rate

Inactive Publication Date: 2019-06-25
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF9 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in high-altitude environments, objects will have relatively small sizes, different types, and variable orientations, which make a priori features difficult to detect
[0005] Recently, the target detection and tracking method based on deep learning is a hot spot of research, including SSD, RCNN, YOLO, etc., but the multi-layer nonlinear processing for feature extraction and learning has high computing and hardware costs, which is not applicable. UAVs with limited computing resources
In addition, due to the free flight of the drone, how to solve the unstable shooting of the motion camera is also a difficult problem
In order to solve this problem, the common method is to use the optical flow method to compensate the camera motion, and then use the clustering algorithm to segment the target, however, the optical flow method is very sensitive to noise and illumination
In addition, compared with the UAV flight situation, the optical flow method has a higher computational complexity, which is more suitable for target detection when the UAV is hovering or flying at a low speed, and is not suitable for the online detection system based on the UAV.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A small target detection method based on an unmanned aerial vehicle
  • A small target detection method based on an unmanned aerial vehicle
  • A small target detection method based on an unmanned aerial vehicle

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0067] In this embodiment, a test platform is built using a quadrotor UAV (DJI M-100) and a Mac notebook to verify the accuracy and real-time performance of the moving target detection and tracking algorithm. The drone DJI M-100 is loaded with the onboard computer Manifold, camera sensor, GPS and IMU modules. The drone has an overall payload of less than 500g and can fly for 15 to 20 minutes.

[0068] Based on the built test platform, the performance of the target detection module is verified in two different scenarios. The scenarios are as follows: figure 2 and 3 shown. figure 2 In the representative scene, only one moving target is captured by the camera of the drone, and the drone is flying in the low sky and circling; image 3 In the scene represented by , there are multiple moving targets, and the UAV is flying at a relatively high altitude. From the figure, we can clearly see that in both cases, the moving target is blocked by obstacles and trees.

[0069] figur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a small target detection method based on an unmanned aerial vehicle, and the method comprises the steps: enabling the unmanned aerial vehicle to fly autonomously to shoot a video; Sequentially reading two frames in the video sequence, calculating a Hessian matrix, and extracting key points in the image; Calculating the Euclidean distance between the key points, and matchingthe key points in the two images according to the Euclidean distance and the Hessian matrix; removing noise points in the key points, and calculating and calibrating a perspective transformation matrix between every two frames of images; And carrying out subtraction on the calibrated current frame and the reference frame to obtain a difference image, carrying out binaryzation, morphological operation, reconstruction and the like on the difference image in sequence, and extracting and marking a foreground target in the image. According to the method, small targets in the aerial video can be effectively extracted and detected through similarity of backgrounds, meanwhile, computing resources of the unmanned aerial vehicle are fully used, and the online target detection capability of the unmanned aerial vehicle is improved.

Description

technical field [0001] The invention relates to an unmanned aerial vehicle and target online detection technology, in particular to a small target detection method based on an unmanned aerial vehicle. Background technique [0002] Unmanned Aerial Vehicles (UAVs) are unmanned aircraft operated by radio remote control equipment and independent program control equipment, or completely or intermittently autonomously operated by an onboard computer. Compared with manned aircraft, drones have the advantages of small size, low cost, low environmental requirements, and strong survivability, and are often more suitable for tasks that are dangerous and harsh. With the rapid development of the UAV manufacturing industry, UAV systems are widely used in smart city management, intelligent traffic monitoring and other fields. Among them, the monitoring of moving targets is a basic but challenging functional requirement in UAV systems, which is closely related to applications such as infra...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/38G06K9/62
Inventor 顾晶晶王秋红黄涛涛
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products