Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Double-branch cross-domain pedestrian re-identification method based on attention calibration

A pedestrian re-identification and attention technology, applied in the field of pedestrian re-identification, can solve the problems of overcomplexity, lack, and attenuation of new styles in unseen domains, and achieve the effect of reducing noise features, alleviating training deviation, and reducing the amount of model parameters

Pending Publication Date: 2022-08-09
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

He et al. used knowledge distillation to train multi-source domain data through the student model and the teacher model, and transferred the knowledge learned by the teacher model to the student model with relatively weak learning ability, so as to enhance the generalization ability of the student model. These methods tends to be overly complex and only removes style differences from a given source domain, so it lacks the ability to sufficiently attenuate new styles for unseen domains

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Double-branch cross-domain pedestrian re-identification method based on attention calibration
  • Double-branch cross-domain pedestrian re-identification method based on attention calibration
  • Double-branch cross-domain pedestrian re-identification method based on attention calibration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The technical solutions of the present invention will be further described below with reference to the accompanying drawings and embodiments.

[0036] like figure 1 As described above, the present invention is a dual-branch cross-domain pedestrian re-identification method based on attention calibration, and the specific steps are:

[0037] S1: Build an end-to-end pedestrian re-identification network based on the attention calibration module; the specific operation is: select the first three convolution blocks of ResNet-50, and use the second convolution block and the third convolution block respectively after the third convolution block. An attention calibration module is added to form a benchmark network. The attention calibration module consists of two convolutional layers, namely the first convolutional layer and the second convolutional layer, a feature calibration FCBN layer and a Sigmoid function, the input feature f i Pass through the first convolution layer, f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a double-branch cross-domain pedestrian re-identification method based on attention calibration, and the method comprises the steps: improving a ResNet-50 reference network through an attention calibration module, introducing a domain invariant feature supplement branch and a domain specific feature global branch, carrying out the linear weighting of domain invariant feature information and domain specific feature information, and obtaining a fusion feature, and the fusion features are normalized to obtain final features of the model. The reference network can fully extract channel information and space information of the features, and the problem of feature misalignment is solved. Model parameter quantity can be reduced by introducing domain specific feature global branches, training deviation is corrected in combination with a reference network, and meanwhile model complexity is reduced, so that the model can fully extract domain specific features. By introducing domain invariant feature supplementary branches, source domain complementary information obtained from calibration features of a specific domain is enriched, and domain specific features extracted from domain specific feature global branches are combined, so that the model has high generalization ability.

Description

technical field [0001] The invention relates to a pedestrian re-identification method, in particular to a double-branch cross-domain pedestrian re-identification method based on attention calibration. Background technique [0002] As one of the most attractive research tasks in the computer vision community, person re-identification aims to judge whether the same pedestrian is contained in views from non-overlapping cameras. It plays an important role in various surveillance applications, such as pedestrian retrieval and public safety incident detection, so it has received the attention of many scholars in the past few years, however, the person re-identification model is applied to new fields after being trained in the source domain The cross-domain recognition problem often occurs when the performance of the dataset is significantly degraded. Most of the existing researches focus on fully supervised person re-identification and have made encouraging progress. However, the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/10G06V10/44G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/048G06N3/045G06F18/241G06F18/253
Inventor 黄盼朱松豪梁志伟
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products