Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Pedestrian re-recognition system and method based on spatial sequence feature learning

A pedestrian re-identification and spatial sequence technology, applied in the field of pedestrian re-identification, can solve problems such as model interference, cumbersome process, and increased algorithm complexity

Active Publication Date: 2021-08-10
GUANGXI ACAD OF SCI
View PDF31 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] (2) Although the introduction of posture and other information through the method of target detection can help improve the model effect, the process is relatively cumbersome and increases the complexity of the algorithm
Moreover, it is a difficult task to perform high-precision attitude detection on pedestrian images. If wrong attitude information is introduced, it will interfere with the model.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian re-recognition system and method based on spatial sequence feature learning
  • Pedestrian re-recognition system and method based on spatial sequence feature learning
  • Pedestrian re-recognition system and method based on spatial sequence feature learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] The network framework used in the present invention is as figure 1As shown, the triplet image is used as input, and the Res2Net-50 network is used for feature extraction, and the feature map extracted by stage4 is input into the global feature branch and the spatial sequence feature learning branch respectively. In the global feature branch, the feature vector is first reduced in dimension through the average pooling operation, and then input to the fully connected layer to map to the classification space, and the Ranked List Loss and AM-Softmax Loss are calculated. In the spatial sequence feature learning branch, the dimensionality is first reduced to 1024 through a 1*1 convolutional layer, and then a random mask is used to suppress some areas of the feature map, and then maximum pooling is performed in the row and column directions to obtain different spatial Dimensionally eigenvectors. Then input them into the self-attention module to learn the spatial sequence feat...

Embodiment 2

[0087] Experimental setup:

[0088] Experimental environment: The code is written using the Pytorch framework and runs on a server configured with two Nvidia TITAN Xp graphics cards.

[0089] Res2Net: The backbone network uses the Res2Net-50 network pre-trained on ImageNet. Its structure is similar to Res2Net-50. Only the residual module is replaced, and the number of sub-feature maps is s=4. The size of the final output feature map is 16*8*2048.

[0090] Spatial sequence feature learning module: self-attention module part, the number of modules is N=4, the module dimension in a single module is d=1024, and the number of multi-head attention heads is h=8. And the random mask part, R h Choose randomly within the set {0, 0.1, 0.2, 0.3}, R w =1.

[0091] GAN network:

[0092] Since the GAN network only generates images, it is necessary to perform data enhancement in the pedestrian recognition model. The present invention uses the Densenet-121 network as the baseline of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pedestrian re-recognition system and method based on spatial sequence feature learning. The pedestrian re-recognition system comprises a Res2Net network, a global feature module and a spatial sequence feature learning module. The global feature module comprises a flat pooling module and a full connection layer module; the Res2Net network is respectively connected with the global feature module and the spatial sequence feature learning module; the spatial sequence feature learning module comprises a convolutional layer, a random mask module, a maximum pooling module and a self-attention module. A spatial sequence feature learning module based on a self-attention mechanism is provided, spatial sequence features in the horizontal direction and the vertical direction are constructed, spatial semantic relation of the spatial sequence features is learned, and effective local features are extracted; a random batch feature erasing training strategy is put forward, and a local area of a feature map is shielded through a random mask block, so that the model is forced to learn suppressed low-frequency local features.

Description

technical field [0001] The invention relates to the field of pedestrian re-identification, in particular to a pedestrian re-identification system and method based on spatial sequence feature learning. Background technique [0002] Pedestrian re-identification is an important research direction in the field of computer vision. With the increasing demand for public security and the popularity of public cameras, the role of pedestrian re-identification technology in the field of intelligent security is becoming more and more important. Traditional pedestrian re-identification research is mainly based on manually constructing pedestrian features. With the development of deep learning technology, the performance of pedestrian re-identification model has been significantly improved, but the resolution of pedestrians is low, the image is occluded, and the size of the data set is small. Factors restrict the improvement of model performance. At this stage, many studies ignore the sp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06N3/048G06N3/045G06F18/241
Inventor 黄德双张焜伍永元昌安
Owner GUANGXI ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products