Unlock instant, AI-driven research and patent intelligence for your innovation.

Device and method for cross-domain person re-identification based on domain-invariant features

A pedestrian re-identification and domain-invariant technology, applied in the field of pedestrian re-identification, can solve the problems of time-consuming and laborious data collection in the target domain, and the inability to collect data in the target domain, etc., to enhance cross-domain generalization capabilities and improve cross-domain generalization Ability, the effect of cross-domain person re-identification performance improvement

Active Publication Date: 2022-07-22
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although many cross-domain person re-identification methods have effectively improved the generalization ability of the model, the collection of target domain data is also time-consuming and laborious, and it is even impossible to collect target domain data in practical applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Device and method for cross-domain person re-identification based on domain-invariant features
  • Device and method for cross-domain person re-identification based on domain-invariant features
  • Device and method for cross-domain person re-identification based on domain-invariant features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] The present invention designs a cross-domain pedestrian re-identification device based on domain-invariant features. The cross-domain pedestrian re-identification device is arranged after the residual module of the domain-invariant feature extraction network, such as figure 2 As shown, it includes a restored feature module for obtaining restored features, a feature enhancement module for obtaining discriminative features, and a feature stacker for stacking the restored features and discriminative features to obtain complete output features

[0056] The recovery feature module is provided with:

[0057] The instance normalization module IN is used to normalize the input original features to obtain the normalized features of the instance;

[0058] Feature Residual Calculator It is used to calculate the residual between the original feature of the input and the feature after instance normalization, and obtain the residual feature;

[0059] The first attention mechani...

Embodiment 2

[0065] This embodiment is further optimized on the basis of the above-mentioned embodiment, and the cross-domain pedestrian re-identification method based on domain-invariant features is implemented by using the cross-domain pedestrian re-identification device based on domain-invariant features, such as figure 2 shown, including the following steps:

[0066] 1) The original features of the input reduce the domain difference between the sample features through the instance normalization module IN, and obtain the features after the instance normalization;

[0067] 2) Utilize the feature residual calculator Perform residual calculation on the input original features and the features after instance normalization to obtain residual features;

[0068] 3) Using the residual feature to extract features related to pedestrian identity information adaptively based on the channel attention mechanism and the spatial attention mechanism by using the first attention mechanism module (incl...

Embodiment 3

[0075] This embodiment is further optimized on the basis of the foregoing embodiment, and the same parts as the foregoing technical solutions will not be repeated here, such as figure 2 As shown, in order to better realize the cross-domain pedestrian re-identification method based on the domain-invariant feature of the present invention, the original feature of the input is set to x, and x∈R b×c×h×w , where b, c, h, and w represent the batch size, the number of channels, the height and width of the feature map, respectively, and R b×c×h×w is a b×c×h×w-dimensional matrix, then the complete output feature after the attention and style normalization module ASN (that is, the cross-domain person re-identification device) is y∈R b×c×h×w ;

[0076] The normalized feature of the instance is set as x 1 , in the step 1), the original feature of the input adopts the following formula to obtain the feature after the instance normalization through the instance normalization module IN: ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a cross-domain pedestrian re-identification device and method based on domain invariant features. Due to instance normalization, the original can be normalized to reduce differences between samples, but at the same time, some pedestrian identity-related information and pedestrians can be filtered out. Re-identification discriminant information. In order to solve this problem, the present invention proposes an attention and style normalization module to recover the lost pedestrian identity-related information and pedestrian re-identification discrimination information; in specific implementation, after the residual module of the domain-invariant feature extraction network A cross-domain person re-identification device (namely, the attention and style normalization module ASN) is set up to recover the lost pedestrian identity-related information and pedestrian re-identification discriminant information, so that the final output image domain invariant features can be used for subsequent Pedestrian re-identification in the classifier.

Description

technical field [0001] The invention relates to the technical field of pedestrian re-identification in the field of computer vision, in particular to a cross-domain pedestrian re-identification device and method based on domain invariant features. Background technique [0002] Pedestrian re-identification, also known as pedestrian re-identification, is a technology that uses computer vision technology to determine whether there is a specific pedestrian in an image or video sequence under conditions of cross-device, time and location. Because of its ability to track and monitor specific personnel in a wide range, it is currently widely used in intelligent monitoring, intelligent security and other fields. [0003] Many methods have been proposed on how to improve the performance of person re-identification models. In the latest research, the performance of person re-identification algorithm has reached very high, but such strong performance is based on the use of a single do...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06V40/10G06V10/46G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06V10/462G06N3/045G06F18/24
Inventor 殷光强王文超李耶贾召钱游长江
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA