Unlock instant, AI-driven research and patent intelligence for your innovation.

Pyramid pooling multi-scale feature learning method adopting attention mechanism

A pyramid pooling and multi-scale feature technology, applied in the field of deep learning, can solve the problem of insufficient nonlinear representation ability of the pyramid pooling model

Inactive Publication Date: 2020-01-17
TSINGHUA UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to overcome the problem of insufficient nonlinear representation ability of the above-mentioned pyramid pooling model, the present invention provides a pyramid pooling multi-scale feature learning method using an attention mechanism

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pyramid pooling multi-scale feature learning method adopting attention mechanism
  • Pyramid pooling multi-scale feature learning method adopting attention mechanism
  • Pyramid pooling multi-scale feature learning method adopting attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The present invention will be further described below using the accompanying drawings and embodiments. The accompanying drawings described here are used to provide a further understanding of the present invention, constitute a part of the present application, and do not constitute a limitation to the present invention.

[0016] A schematic diagram of a pyramid pooling multi-scale feature learning method using the attention mechanism is shown in the appendix figure 1 , characterized by including: a pyramid pooling model and an attention model. Among them, the pyramid pooling model is composed of multiple adaptive pooling channels with different pooling window sizes connected in parallel to extract multi-scale features; the attention model uses nonlinear functions to represent the different channel features generated by the pyramid pooling model and assign weights to each channel to strengthen useful features while suppressing useless features.

[0017] A single path of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pyramid pooling multi-scale feature learning method adopting an attention mechanism. The pyramid pooling multi-scale feature learning method is characterized by comprising apyramid pooling model and an attention model. The pyramid pooling model is formed by connecting a plurality of self-adaptive pooling paths with different pooling window sizes in parallel, and is usedfor extracting multi-scale context features. The attention model represents the relationship between different channel features generated by the pyramid pooling model through a nonlinear function, andallocates weights to the channels to reinforce useful features and suppress useless features. According to the pyramid pooling multi-scale feature learning method adopting the attention mechanism, the multi-scale feature learning capability of a pyramid pooling model can be enhanced, the method can be flexibly embedded into a convolutional neural network model, and the method is suitable for various tasks such as image semantic segmentation, target detection and image classification.

Description

technical field [0001] The invention belongs to the field of deep learning, in particular to a pyramid pooling multi-scale feature learning method using an attention mechanism. Background technique [0002] Multi-scale features are often used in deep convolutional networks to improve network performance. As the most commonly used multi-scale feature extraction model, the pyramid pooling model extracts multi-scale context features by paralleling multiple adaptive pooling channels with different pooling window sizes, and then uses 1×1 convolution to linearly fuse the features of each channel . However, the use of linear functions alone is not enough to describe the nonlinear relationship between channels of multi-scale features, resulting in the inability of the pyramid pooling model to effectively extract multi-scale features. Contents of the invention [0003] In order to overcome the problem of insufficient nonlinear representation ability of the above-mentioned pyramid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/46G06N3/04
CPCG06V10/44G06N3/045
Inventor 王吴凡朱纪洪杨佳利匡敏驰闫星辉史恒
Owner TSINGHUA UNIV