Pedestrian attribute identification system and method based on multilayer feature learning

A technology of attribute recognition and feature learning, applied in the field of computer vision, can solve the problems of not being able to learn, not paying attention to learning, not being able to better use and integrate multi-layer features, etc., to achieve the effect of enhancing prediction results and enhancing experimental results

Active Publication Date: 2019-07-23
SUN YAT SEN UNIV
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Existing technologies are not very good at learning the required features for each attribute, because the multi-layer feature fusion done in these works is only done at the feature level, and most of the operations are splicing feature vectors. It cannot make better use of and integrate multi-layer features, and there is no corresponding learning for each specific attribute to pay attention to the features of each layer

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian attribute identification system and method based on multilayer feature learning
  • Pedestrian attribute identification system and method based on multilayer feature learning
  • Pedestrian attribute identification system and method based on multilayer feature learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0046] Such as figure 1 , figure 2 , image 3 As shown, the present embodiment provides a pedestrian attribute recognition system based on multi-layer feature learning, including a pedestrian attribute recognition network training module and a pedestrian attribute recognition system test module, and the pedestrian attribute recognition network training module includes bottom-up feature extraction module, top-down feature fusion module, feature prediction module and multi-layer prediction fusion module.

[0047]In this embodiment, the bottom-up feature extraction module: this module is based on a classic convolutional neural network, as a module that processes pictures layer by layer to obtain multi-layer features. This embodiment selects the classic network ResNet- 50 as the main body of the module, and the four Residual Blocks (residual modules) in ResNet-50 are used as the layer of feature output. The structure of the residual module is as follows Figure 4 As shown, t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a pedestrian attribute recognition system and method based on multi-layer feature learning, the system comprises a feature bottom-to-top extraction module, a bottom-to-top feature fusion module, a feature prediction module, a multi-layer prediction fusion module and a test module, and the method comprises the following specific steps: processing pictures layer by layer frombottom to top to obtain multi-layer features; fusing the features of the adjacent layers layer by layer from top to bottom, compressing the channel by the feature map obtained by the higher layer, carrying out feature fusion and channel dimension reduction on the compressed channel and the feature map sampled by the upper layer, and outputting the feature of the current layer; obtaining preliminary prediction results of different levels through a maximum pooling layer and a full connection layer according to the fused features and the extracted uppermost features; overlapping the preliminaryprediction results of different levels, and correspondingly endowing each attribute predicted by each level with a weight value to obtain a final prediction result; and extracting a prediction resultcorresponding to the picture, and calculating a result of each index. According to the method, a group of specific weights are learned for each attribute according to the predicted values obtained bythe fused features, so that each attribute can better utilize multi-layer features to obtain a better recognition effect.

Description

technical field [0001] The invention relates to the field of computer vision based on deep learning, in particular to a pedestrian attribute recognition system and method based on multi-layer feature learning. Background technique [0002] Pedestrian attribute recognition, also known as human body attribute recognition, is to identify the attributes of pedestrians in pictures, such as hair color, hair length, clothing type, clothing color, etc., which is a multi-label classification problem. Pedestrian attribute recognition is widely used in pedestrian re-identification and pedestrian detection under the monitoring system, and pedestrian attributes can be used to assist these tasks. In the field of pedestrian attribute recognition, most of the existing methods are based on the implementation of deep learning. For example, the attention mechanism is used to generate the attention map and applied to each layer of the neural network to obtain different features, that is, the at...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04
CPCG06V40/10G06N3/045G06F18/214G06F18/25
Inventor 袁宝煜郑伟诗
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products