Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unsupervised pedestrian re-identification method based on heterogeneous graph

A pedestrian re-identification, unsupervised technology, applied in neural learning methods, character and pattern recognition, neural architecture, etc., can solve problems such as inability to directly deploy and use, without considering the complex topology of unlabeled data, and poor performance.

Active Publication Date: 2021-03-19
SOUTH CHINA UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In these studies, although supervised training algorithms can show good results on public data sets, when these algorithms are applied to a brand new unlabeled camera network, the results are often poor and cannot be directly deployed. Therefore, how to efficiently use massive unlabeled pedestrian images for model optimization training is a challenging problem.
[0003] Today's mainstream unsupervised person re-identification methods are mainly based on pseudo-label and similarity methods, but these methods do not consider the complex topological structure of unlabeled data in space, and these complex topological structures can truly reflect the distribution of samples. , which can provide sufficient information to assist model optimization training

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised pedestrian re-identification method based on heterogeneous graph
  • Unsupervised pedestrian re-identification method based on heterogeneous graph
  • Unsupervised pedestrian re-identification method based on heterogeneous graph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] This embodiment discloses a method for unsupervised pedestrian re-identification based on heterogeneous graphs, the method includes the following steps:

[0056] S1, obtain the camera device ID information related to the pedestrian image and the pedestrian image, and divide the pedestrian image into a training set pedestrian image and a test set pedestrian image;

[0057] S2, to the training set pedestrian image that obtains in step S1, utilize convolutional neural network model to carry out the extraction of pedestrian feature;

[0058] S3. Use each pedestrian image in the training set as a vertex, and calculate the edge between the vertex and the vertex using the pedestrian features obtained in step S2, and then perform heterogeneous screening on all the edges between the vertex and the vertex to construct a camera-related Heterogeneous graph;

[0059] S4. Propagate the heterogeneous similarity of the heterogeneous graph obtained in step S3. After the propagation is ...

Embodiment 2

[0103] The embodiment of the present invention also provides a computer storage medium, the computer storage medium stores computer-executable instructions, and the computer-executable instructions can execute the heterogeneous graph-based unsupervised pedestrian re-identification method in the first embodiment above. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a flash memory (Flash Memory), a hard disk (Hard Disk) Disk Drive, abbreviation: HDD) or solid-state hard drive (Solid-State Drive, SSD), etc.; the storage medium may also include a combination of the above-mentioned types of memory.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an unsupervised pedestrian re-identification method based on a heterogeneous graph. The method comprises the following steps: acquiring a pedestrian image and dividing the pedestrian image into a training set pedestrian image and a test set pedestrian image; constructing a camera-related heterogeneous graph for the pedestrian images in the training set; executing heterogeneous similarity propagation based on the heterogeneous graph, and efficiency mining then spatial similarity between vertexes from the heterogeneous graph; optimizing the convolutional neural network model by using heterogeneous similarity learning; and utilizing the optimized convolutional neural network model to carry out re-identification on the pedestrian image in the test set. According to themethod, the heterogeneity of the pedestrian images is fully considered on the basis of unsupervised learning, so that the defect that a traditional unsupervised learning method cannot fully consider acomplex topological structure between the unlabeled pedestrian images is effectively overcome.

Description

technical field [0001] The invention belongs to the field of intelligent security, and relates to surveillance video pedestrian re-identification analysis, in particular to an unsupervised pedestrian re-identification method based on heterogeneous graphs. Background technique [0002] Pedestrian re-identification, the main research is to accurately retrieve image frames containing a certain pedestrian from multiple cameras. Due to the existence of inconsistent lighting, inconsistent angles, occlusion and blurred faces, the research topic of person re-identification has attracted a large number of researchers to study. In these studies, although supervised training algorithms can show good results on public data sets, when these algorithms are applied to a brand new unlabeled camera network, the results are often poor and cannot be directly deployed. Therefore, how to efficiently use massive unlabeled pedestrian images for model optimization training is a challenging problem...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V20/53G06N3/045G06F18/22G06F18/2415G06F18/214Y02T10/40
Inventor 吕建明林少川梁天保胡超杰莫晚成
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products