Small target detection method based on feature fusion and depth learning

A technology of small target detection and feature fusion, which is applied in the direction of character and pattern recognition, instruments, computer parts, etc., can solve the problems of high detection accuracy, impossibility, and real-time reduction, so as to improve detection accuracy, improve detection effect, The effect of high detection accuracy

Inactive Publication Date: 2019-02-15
XIDIAN UNIV
View PDF2 Cites 183 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, these two types of network models have their own advantages. The detection accuracy of the convolutional neural network model based on the candidate area is generally high, but the real-time performance is poor; It has a lot to do with it. To detect small targets, it often requires a larger number of meshes, and the real-time performance will decrease accordingly.
The above two mainstream models still cannot achieve high detection accuracy for small targets in the image while ensuring real-time detection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Small target detection method based on feature fusion and depth learning
  • Small target detection method based on feature fusion and depth learning
  • Small target detection method based on feature fusion and depth learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] Target detection is an important research topic in the field of image applications, such as crop detection in smart agriculture, park security detection in the placement field, and so on. At present, there are still many problems in the detection of small targets in images, such as being easily affected by factors such as illumination, rotation, and image scale, but the detection of small targets is very meaningful. For example, using drones for aerial photography, objects in aerial images are often Relatively small, the detection of small targets is an urgent problem to be solved, so the present invention proposes a depth model for small target detection.

[0024] The present invention is a small target detection method based on feature fusion and deep learning, see figure 1 , including the following steps:

[0025] (1) Prepare the atlas: use the training data set of the image set PASCAL VOC2007 and PASCAL VOC2012 as the training set, and use the test data set of the ...

Embodiment 2

[0032] The small target detection method based on feature fusion and deep learning is the same as embodiment 1, and the small target detection network model based on feature fusion and deep learning is set up in step (2) of the present invention, see figure 2 , follow the steps below:

[0033] (2a) Use the first conv4_3 layer of the residual network ResNet101 to build the basic network: increase the connection between non-adjacent but the same resolution layers in the residual network to form the basic network. The input of the basic network is the image to be detected, which is used to extract the image into a feature map of each scale. Since the connection between layers that are not adjacent but have the same resolution is added in the residual network, the loss of information after the convolution operation and the activation function is effectively prevented, and the problems of gradient disappearance and gradient explosion in the deep network model are reduced. , so it...

Embodiment 3

[0038] The small target detection method based on feature fusion and deep learning is the same as in embodiment 1-2, and the construction of a feature pyramid network structure described in step 2c is used to realize multi-scale target detection in target detection, see figure 2 , including:

[0039] (2c1) Build a feature pyramid based on multi-scale feature maps from the conv3, conv5, conv6, conv7, conv8, conv9 network layers in the feature extraction network.

[0040] (2c2) Use the deconvolution operation to upsample the feature maps of the high-level and low-resolution conv5 and conv6 layers in the pyramid structure to obtain the same resolution as the feature maps of the shallow feature maps conv3 and conv5 layers, and add them according to the elements The method performs feature fusion on the high-level feature map and the shallow feature map, and obtains the feature maps of the conv3 and conv5 layers that are more descriptive after fusion.

[0041] The difficulty of s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a small target detection method based on feature fusion and depth learning, which solves the problems of poor detection accuracy and real-time performance for small targets. The implementation scheme is as follows: extracting high-resolution feature map through deeper and better network model of ResNet 101; extracting Five successively reduced low resolution feature maps from the auxiliary convolution layer to expand the scale of feature maps. Obtaining The multi-scale feature map by the feature pyramid network. In the structure of feature pyramid network, adopting deconvolution to fuse the feature map information of high-level semantic layer and the feature map information of shallow layer; performing Target prediction using feature maps with different scales and fusion characteristics; adopting A non-maximum value to suppress the scores of multiple predicted borders and categories, so as to obtain the border position and category information of the final target. The invention has the advantages of ensuring high precision of small target detection under the requirement of ensuring real-time detection, can quickly and accurately detect small targets in images, and can be used for real-time detection of targets in aerial photographs of unmanned aerial vehicles.

Description

technical field [0001] The invention belongs to the technical field of image information processing, and mainly relates to deep learning target detection, specifically a small target detection method based on feature fusion and deep learning, which can be used for real-time positioning and classification of small targets. Background technique [0002] Target detection is a challenging topic in the field of computer vision. At present, target detection methods based on deep learning are mainly divided into two categories, one is the convolutional neural network model based on the candidate area, and the other is the convolutional neural network model based on regression. network model. A deep convolutional neural network model based on candidate regions: R-CNN network and various optimized networks of R-CNN. The R-CNN network model first extracts candidate borders through a selective search algorithm, then uses a deep convolutional neural network (DCNN) to extract features f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/32G06K9/62
CPCG06V10/255G06F18/253G06F18/214
Inventor 孙伟张桢浩
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products