Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and system for image person re-identification based on multi-attention joint learning

A pedestrian re-identification and attention technology, applied in the field of pedestrian re-identification research, can solve the problem of low accuracy of pedestrian re-identification, achieve the effect of improving learning ability, improving performance, and strengthening representation learning

Active Publication Date: 2022-03-15
HUAZHONG UNIV OF SCI & TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the defect of low pedestrian re-identification accuracy caused by the use of single attention in the prior art and the need for improvement, the present invention provides a method and system for image pedestrian re-identification based on multi-attention joint learning, the purpose of which is to use the Soft attention module And high-order attention module, extract more robust and more discriminative features, and obtain the similarity between images, improve the accuracy of recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for image person re-identification based on multi-attention joint learning
  • A method and system for image person re-identification based on multi-attention joint learning
  • A method and system for image person re-identification based on multi-attention joint learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The present invention simultaneously introduces the Soft attention module and the high-order attention module into the ResNet50 network to form a multi-attention joint learning network, initializes the multi-attention joint learning network with the pre-trained ResNet50 network parameters, and then in the Market-1501 data set After training, the network can extract effective pedestrian representation features for pedestrian re-identification.

[0051] The invention discloses an image pedestrian re-identification method based on multi-attention joint learning, which includes the following steps:

[0052] Step 1. Pre-train the ResNet50 network so that the ResNet50 network parameters have initial values.

[0053] Get the ImageNet dataset, the URL of the dataset is https: / / www.image-net.org / , use the amsgrad algorithm to update the network parameters, the formula of the amsgrad algorithm is:

[0054] m t = β 1 m t-1 +(1-β 1 ) g t

[0055]

[0056]

[0057]

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image pedestrian re-identification method and system based on multi-attention joint learning, belonging to the technical field of image processing. The present invention introduces Soft attention and high-order attention into the ResNet50 feature extraction network, uses the complementary effects of two different types of attention on feature extraction, improves the feature extraction network's ability to learn pedestrian features, and makes the feature extraction network Focus on more discriminative features in pedestrian images. In order to obtain more accurate attention features, a multi-level attention loss function is proposed. This loss function is used to guide the training and learning of the feature extraction network, and further improve the learning ability of the feature extraction network for pedestrian features. While learning the global features of pedestrians, the intermediate features in the feature extraction network are fused and the learning of local features of pedestrians is strengthened, which improves the ability of the network to learn the subtle differences between pedestrian features, and improves the performance of the network in image pedestrian re-identification.

Description

technical field [0001] The invention belongs to the research field of pedestrian re-identification in image processing and machine vision, and in particular relates to an image pedestrian re-identification method and system based on multi-attention joint learning. Background technique [0002] Pedestrian re-identification is a fundamental task in automatic video surveillance, and it is also a research hotspot in recent years. The purpose of person re-identification is to establish corresponding links between observations of the same person under different cameras. Typically, this is done by taking an image (or set of images) of a person seen in one camera view and forming a descriptive model for comparison with images of pedestrians observed in another camera view or point in time . Its purpose is to determine the past (or present) position of a person in a set of cameras by finding the correct matching image. [0003] Person re-identification is a very difficult research...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06V40/10G06V20/52G06V10/74G06V10/774G06V10/82G06K9/62G06N3/04
CPCG06V40/103G06N3/048G06N3/045G06F18/22G06F18/214
Inventor 韩守东罗善益张宏亮刘东海生
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products