Pedestrian re-identification system and method

A pedestrian re-identification and pedestrian technology, applied in the field of pedestrian re-identification, can solve the problems of low accuracy rate, low re-identification accuracy rate, unclear pedestrian outline, etc., to improve accuracy rate, improve image clarity, and improve feature representation ability and the effect of discriminative ability

Active Publication Date: 2019-05-24
BEIJING JIAOTONG UNIV
View PDF8 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the above implementation scheme still has the following defects: because the network extracts global features and does not focus on features with a large contribution, the image features extracted by the neural network have the same contribution, and no corresponding enhancement and Weakening, low accuracy; at the same time, the loss function of the classification task and the verification task uses cross-entropy loss, which cannot evaluate the distance between features, resulting in low re-identification accuracy; the image captured by the camera has low pixels and the outline of pedestrians is not clear , directly extracting the features of the original image can easily lead to classification errors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian re-identification system and method
  • Pedestrian re-identification system and method
  • Pedestrian re-identification system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] Such as figure 2 As shown, Embodiment 1 of the present invention provides a pedestrian re-identification system, which includes:

[0044] The image reconstruction module is used to perform image reconstruction on different original images through a deep learning network based on sparse coding to obtain a corresponding reconstruction matrix;

[0045] The feature extraction module is used to extract the corresponding feature vectors in different reconstruction matrices in combination with the attention mechanism neural network;

[0046]The loss calculation module is used to calculate the classification loss results and verification loss results of the corresponding feature vectors in each reconstruction matrix, judge whether the feature extraction module converges according to the classification loss results and the verification loss results, and if converged, then Send the corresponding feature vectors in each reconstruction matrix to the judgment module; otherwise, up...

Embodiment 2

[0065] Embodiment 2 of the present invention provides a pedestrian re-identification method based on image reconstruction, attention mechanism and multi-task loss function, which is used to judge whether the images acquired by different cameras belong to the same individual.

[0066] Specifically, the system described in Embodiment 2 of the present invention uses the twin network structure in deep learning to input two different images of pedestrians, uses the pedestrian features obtained through the twin network for testing, calculates the feature distance, and judges whether the pedestrian in the corresponding image Whether the pedestrians belong to the same pedestrian.

[0067] The Siamese network consists of two parts, a parameter-sharing reconstruction network and a parameter-sharing attention network. The reconstruction network uses a deep learning network based on sparse coding, which can obtain more image detail information by reconstructing the image. The attention n...

Embodiment 3

[0083] Such as Figure 5 As shown, Embodiment 3 of the present invention provides a method for re-identifying pedestrians using the system described in Embodiment 2. The method includes the following process steps:

[0084] Step 1: Before the image is input to the network, image preprocessing is performed. Including adjusting the image to a fixed size, removing the mean value, and setting the method of randomly selecting input image sample pairs.

[0085] Step 2: The preprocessed image is first input to the image reconstruction module, and the reconstruction network in this module is used to reconstruct the input image to obtain its reconstruction matrix.

[0086] Step 3: The reconstruction matrix obtained in step 2 (that is, the reconstruction module) is input into the attention module, and the attention network is propagated forward to extract the feature vector of the reconstruction matrix.

[0087] Step 4: Input the feature vector of each image obtained in step 3 into th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a pedestrian re-identification system and method, and belongs to the technical field of pedestrian re-identification. The system comprises the following steps of carries out image reconstruction on different original images through a deep learning network based on sparse coding to obtain corresponding reconstruction matrixes; extracting a feature vector in each reconstruction matrix in combination with an attention mechanism; calculating a classification loss result and a verification loss result of the feature vector; and judging whether the feature extraction module converges or not according to the classification loss result and the verification loss result, if yes, calculating a difference degree between the feature vectors of different reconstruction matrixes, if the difference degree is greater than a set threshold value, determining that the feature vectors do not belong to the same pedestrian, and if the difference degree is less than the set threshold value, determining that the feature vectors belong to the same pedestrian. According to the invention, the reconstructed sub-network is used to reconstruct the image so as to improve the image definition, and the multi-task loss function is used to shorten the distance between the same individuals, thereby improving the feature representation capability and discrimination capability of the network,and improving the pedestrian re-identification accuracy.

Description

technical field [0001] The invention relates to the technical field of pedestrian re-identification, in particular to a pedestrian re-identification system and method based on image reconstruction, attention mechanism and multi-task loss function. Background technique [0002] With the development of deep learning, neural network technology is applied in more and more scenarios, and person re-identification, as a popular research direction in the field of computer vision, is also receiving more and more attention. At present, the research on person re-identification is mainly based on representation learning and metric learning. Because the neural network can automatically extract the representational features from the original image data according to the task requirements, many scholars regard the pedestrian re-identification problem as a classification problem or a verification problem, and use a single branch network or a twin network to extract pedestrian features. Alth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46
Inventor 滕竹李芮张宝鹏田佳杰李妍
Owner BEIJING JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products