Unlock instant, AI-driven research and patent intelligence for your innovation.

Multi-scale and attention mechanism combined remote sensing image aircraft target detection method

A remote sensing image and aircraft target technology, applied in the field of remote sensing image aircraft target detection, can solve problems such as loss of aircraft feature information, feature information cannot accurately describe the target, etc., and achieve the effects of good detection effect, improved average accuracy, and high detection accuracy.

Inactive Publication Date: 2021-01-12
PLA STRATEGIC SUPPORT FORCE INFORMATION ENG UNIV PLA SSF IEU
View PDF1 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problem that the existing YOLO V4 algorithm is used for remote sensing image aircraft target detection, the aircraft feature information is lost, and the fused feature information cannot accurately describe the target. The present invention provides a remote sensing image aircraft target that combines multi-scale and attention mechanisms. The detection method, by fusing feature information of more scales, increasing the attention mechanism, improving the network, and improving its performance in detecting aircraft targets in remote sensing images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-scale and attention mechanism combined remote sensing image aircraft target detection method
  • Multi-scale and attention mechanism combined remote sensing image aircraft target detection method
  • Multi-scale and attention mechanism combined remote sensing image aircraft target detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] Such as figure 2 As shown, the embodiment of the present invention provides an improved YOLO V4 network (referred to as the M-YOLO V4 network in the present invention) for remote sensing image aircraft target detection, and the improved YOLO V4 network uses the 104× output of the original backbone network. 104 feature maps, as the first detection scale; the 104×104 feature maps are 2 times downsampled and fused with the 52×52 feature maps output by the original FPN network (multi-scale feature fusion network) to obtain new 52×52 features Figure, as the second detection scale; the new 52×52 feature map is 2 times downsampled and fused with the 26×26 feature map output by the original FPN network to obtain a new 26×26 feature map, which is used as the third detection scale; The new 26×26 feature map is 2 times downsampled and fused with the 13×13 feature map output by the original FPN network to obtain a new 13×13 feature map as the fourth detection scale; wherein, the i...

Embodiment 2

[0029]In general, the feature map extracted by CNN contains rich target feature information, and there is also a large amount of background information, which will reduce the detection performance. The original YOLO V4 network uses the concat operation to fuse feature maps of different scales, but the concat operation is simply connected in the channel dimension, which cannot reflect the importance and relevance of different features, and the fused feature map cannot accurately describe Target.

[0030] Therefore, on the basis of the above examples, as image 3 As shown, the improved YOLO V4 network provided by the embodiment of the present invention also includes an attention mechanism module, which uses the Squeeze-and-ExcitationBlock (SE Block for short) in SENet; the SE Block is used for feature fusion , assigning weights to each pixel in the channel dimension.

[0031] Specifically, SE Block includes three parts: Squeeze, Excitation and Reweight, such as Figure 4 show...

Embodiment 3

[0035] Based on the improved YOLO V4 network in the above embodiments, the embodiment of the present invention provides a remote sensing image aircraft target detection method that combines multi-scale and attention mechanisms, including:

[0036] S101: Acquire feature maps of four detection scales of the input image, where the four detection scales are respectively a first detection scale, a second detection scale, a third detection scale, and a fourth detection scale;

[0037] S102: Perform seven convolutions on the feature maps of the four detection scales, and then input the convolved feature maps to corresponding SE Blocks to obtain fused feature maps.

[0038] The remote sensing image aircraft target detection method combining multi-scale and attention mechanism provided by the present invention is based on the YOLOV4 algorithm, and the M-YOLO V4 algorithm suitable for combining multi-scale and attention mechanisms is designed for remote sensing image aircraft target dete...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an improved YOLO V4 network and a multi-scale and attention mechanism combined remote sensing image aircraft target detection method. The improved YOLO V4 network adopts a 104 *104 feature map output by an original backbone network as a first detection scale; double downsampling is performed on the 104 * 104 feature map, and the 104 * 104 feature map is fused with a 52 * 52feature map output by an original FPN network to obtain a new 52 * 52 feature map as a second detection scale; double downsampling is performed on the new 52 * 52 feature map, and the new 52 * 52 feature map is fused with a 26 * 26 feature map output by the original FPN network to obtain a new 26 * 26 feature map as a third detection scale; double downsampling is performed on the new 26 * 26 feature map, and the new 26 * 26 feature map is fused with a 13 * 13 feature map output by the original FPN network to obtain a new 13 * 13 feature map as a fourth detection scale; the improved YOLO V4 network further comprises a 7-convs module which is used for executing seven times of convolution on the fused feature map. According to the invention, the network is improved by fusing feature information of more scales and increasing an attention mechanism, and the performance for detecting the remote sensing image aircraft target is improved.

Description

technical field [0001] The invention relates to the technical field of aircraft target detection, in particular to a remote sensing image aircraft target detection method combining multi-scale and attention mechanism. Background technique [0002] With the rapid development of science and technology, remote sensing technology has become more and more mature, and has been widely used in civilian and military fields. Among them, remote sensing image aircraft target detection is one of the important research directions of remote sensing technology application. Aircraft is an important civil and military object, and has important application value in target interpretation, traffic safety and emergency rescue. However, the aircraft targets in remote sensing images are small in size and densely arranged, and the traditional target detection technology is difficult to meet the needs of fast and high precision. [0003] In recent years, methods based on deep learning have been wid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04
CPCG06V20/13G06V10/40G06N3/048G06N3/045G06F18/214
Inventor 江刚武徐佰祺刘建辉王鑫余培东
Owner PLA STRATEGIC SUPPORT FORCE INFORMATION ENG UNIV PLA SSF IEU