Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unsupervised cross-domain pedestrian re-identification method based on clustering

A pedestrian re-identification and unsupervised technology, applied in the field of unsupervised cross-domain pedestrian re-identification based on clustering, can solve the problems of clustering algorithm wrong labels, great influence, and unknown number of target domain categories, etc., to achieve Rich information and good discrimination

Pending Publication Date: 2020-10-30
CHINA UNIV OF MINING & TECH
View PDF0 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (2) The number of classes in the target domain is uncertain, and the clustering algorithm will produce some wrong labels, and noise will inevitably appear in the final pseudo-labels;
[0006] (3) Using the k-means clustering method needs to manually set the number of clusters, and different values ​​of the number of clusters have a great impact on the clustering effect, and unsupervised cross-domain person re-identification is an open set task, we The number of categories in the target domain is unknown

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised cross-domain pedestrian re-identification method based on clustering
  • Unsupervised cross-domain pedestrian re-identification method based on clustering
  • Unsupervised cross-domain pedestrian re-identification method based on clustering

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The technical scheme of the present invention will be further explained below in conjunction with the drawings.

[0059] Reference figure 1 , figure 2 The specific steps of the cluster-based unsupervised cross-domain pedestrian re-identification method of the present invention are as follows:

[0060] Step 1: Build a neural network for pre-training

[0061] (11) Build a feature extraction module and introduce a self-attention mechanism;

[0062] (111) Take the residual network resnet50 as the feature extraction module;

[0063] (112) In the middle of the third layer of resnet50, insert a non-local layer as a self-attention module.

[0064] (12) Build a global joint pooling module;

[0065] (121) Perform global maximum pooling on the extracted feature maps to obtain feature vector X1;

[0066] (122) Perform global average pooling on the extracted feature maps to obtain feature vector X2;

[0067] (123) Fuse X1 and X2, and finally get the pedestrian feature representation F;

[0068] (...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an unsupervised cross-domain pedestrian re-identification method based on clustering, and belongs to the field of computer vision. The method specifically comprises the following steps: (1) establishing a neural network for pre-training; (2) inputting the labeled data in the source domain into a pre-training network, and performing supervised pre-training; (3) building a double-flow mutual learning network framework for fine adjustment; (4) training a double-flow mutual learning framework, and outputting a pedestrian re-identification model suitable for a target domain.Unsupervised cross-domain pedestrian re-identification is realized by utilizing a labeled source domain data set, a label-free target domain data set and a mutual learning network framework; according to the method, a self-attention mechanism and global joint pooling operation are introduced, a new loss function, namely joint flexible optimization loss, is provided, and a clustering method more suitable for open set data is selected, so that the model performance is obviously improved.

Description

Technical field [0001] The invention belongs to the technical field of image retrieval, and specifically designs an unsupervised cross-domain pedestrian re-recognition method based on clustering for cross-domain image retrieval. Background technique [0002] Pedestrian re-identification (re-ID) is a sub-problem of image retrieval. Its purpose is to determine whether the pedestrians in the images taken by different cameras are the same. This is a promising but challenging direction, because human images are usually affected by factors such as occlusion, illumination, and posture changes, making re-identification difficult. With the advent of convolutional neural networks and residual neural networks, pedestrian re-recognition based on supervised learning has achieved high performance. However, supervised learning requires a large amount of labeled pedestrian data, and due to the existence of domain gaps, the model trained on the source data set often suffers a great performance d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/103G06N3/045G06F18/2321G06F18/22G06F18/241
Inventor 周勇侯浩鹏赵佳琦夏士雄姚睿陈莹张迪张曼
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products