Pedestrian attribute recognition method based on multi-temporal attention model

An attention model and attribute recognition technology, applied in the field of pedestrian attribute recognition, can solve the problem of low recognition accuracy and achieve the effect of optimizing feature distribution

Active Publication Date: 2019-11-15
TIANJIN UNIV
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, there are special situations in the pedestrian attribute recognition task, that is, some attributes that account for a small proportion of the whole have relatively high recognition accuracy. On the contrary, some attributes that account for a large proportion of the whole have relatively low recognition accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian attribute recognition method based on multi-temporal attention model
  • Pedestrian attribute recognition method based on multi-temporal attention model
  • Pedestrian attribute recognition method based on multi-temporal attention model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The pedestrian attribute recognition method based on the multi-temporal attention model of the present invention will be described in detail below in conjunction with the embodiments and the accompanying drawings.

[0042]Such as figure 1 As shown, the pedestrian attribute recognition method based on the multi-temporal attention model of the present invention comprises the following steps:

[0043] 1) Obtain image features and attribute features; where,

[0044] Described acquisition image feature is to input image into convolutional neural network (CNN) to obtain image feature V={v 1 ,...v i ,...v N}, such as using VGGNet, GoogleNet, ResNet and other convolutional neural network models to extract image features, the present invention uses ResNet-152 network to extract image features.

[0045] The attribute feature described is to use One-Hot's vector y t To represent the attribute feature, there are L features for setting pedestrian attributes, that is, the image ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a pedestrian attribute recognition method based on a multi-temporal attention model. The pedestrian attribute recognition method comprises the steps: obtaining image features and attribute features; constructing text supervision features, fusing two combination results of the image features and the attribute features, and cascading the attribute features to serve as attribute supervision; constructing a multi-temporal attention mechanism, namely constructing an alignment model of the attention mechanism by utilizing hidden layer vectors at two moments, and then jointlycarrying out weight optimization on image features; taking the text supervision feature and the context vector as additional input of a long-term and short-term memory model to obtain a hidden layer vector containing pedestrian attribute information; and obtaining a pedestrian attribute recognition probability; and optimizing the pedestrian attribute recognition probability. The pedestrian attribute recognition method can quickly and effectively recognize the attributes of different pedestrians in a real monitoring scene, plays an important role in promoting other deep learning fields, such aspedestrian retrieval and pedestrian re-recognition, and also plays a great positive role in building a safe city and perfecting a city monitoring system.

Description

technical field [0001] The invention relates to a pedestrian attribute recognition method. In particular, it involves a method for pedestrian attribute recognition based on a multi-temporal attention model. Background technique [0002] In modern cities, there are millions of surveillance cameras collecting video and picture information of pedestrians and traffic at all times. In order to protect people's lives and property and urban safety, it is necessary to analyze these massive data in real time. Early The monitoring system requires manual screening of data, which consumes a lot of manpower and material resources. With the development of machine learning, especially the rise of deep learning, it has become more convenient to process massive amounts of data. The task of pedestrian attribute recognition aims to predict the attributes of pedestrians, such as gender, age, clothing type, etc., when given an image containing pedestrians. It is important for processing massiv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06K9/00
CPCG06V40/10G06V20/30G06F18/253G06F18/214Y02T10/40
Inventor 冀中贺二路
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products