Pedestrian re-identification method and system based on key point optimization and multi-hop attention graph convolution

A pedestrian re-identification and key point technology, applied in the field of image recognition, can solve problems such as unreliability and poor learning effect, and achieve the effects of improving accuracy, enhancing detection ability, and improving learning ability

Active Publication Date: 2021-09-07
SHANDONG NORMAL UNIV
View PDF8 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the inventor found in the research that although there are many solutions to the occluded pedestrian re-identification problem, most of them adopt the method of directly discarding the occlusion points. For example, some body parts below the input image are occluded, which leads to The learni...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian re-identification method and system based on key point optimization and multi-hop attention graph convolution
  • Pedestrian re-identification method and system based on key point optimization and multi-hop attention graph convolution
  • Pedestrian re-identification method and system based on key point optimization and multi-hop attention graph convolution

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] This embodiment discloses a pedestrian re-identification method based on key point optimization and multi-hop attention map convolution. The invention is mainly divided into three parts: feature extraction and optimization, feature learning and feature matching. Symmetric key Point optimization is used to extract as many effective features as possible to reduce the impact of the occluded part of pedestrians on the whole. In the feature learning part, multi-hop attention map convolution is added, which can maximize the use of valuable information in features, thereby improving the discrimination accuracy.

[0046] Specifically, see the attached Figure 1-2 As shown, it includes: building a feature extraction part mainly composed of a convolutional neural network and a human body key point extraction network and performing pre-training, and then adding an optimization network for human body key point optimization, and the two jointly form a feature extraction and optimiza...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention proposes a pedestrian re-identification method and system based on key point optimization and multi-hop attention graph convolution, and the method comprises the steps: extracting key points in an image, obtaining a confidence level corresponding to each key point, and obtaining a pedestrian re-identification result based on the low confidence level of the corresponding key point when a pedestrian in the image is shielded; approximately estimating feature information of the shielded key points by using corresponding features of other key points for the key points with low confidence levels; for the processed feature information of the key points, using an added feature learning network with a multi-hop attention mechanism for learning, considering effective information of each layer in the network, combining with an attention matrix with the feature information to acquire output of feature learning; and for the output features, enabling the feature matching network to compare the node relationship in the two images through a graph matching algorithm and the human body topological features, and output a predicted classification result. According to the invention, the precision of re-identification of shielded pedestrians is improved.

Description

technical field [0001] The invention belongs to the technical field of image recognition, and in particular relates to a pedestrian re-identification method and system based on key point optimization and multi-hop attention map convolution. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] The goal of person re-identification is to find a specified person among multiple uncorrelated cameras. Most of the existing methods use deep learning methods to obtain human appearance features by training neural networks. These methods may achieve good results on several specific data sets, but in actual situations due to camera The captured images may not construct an ideal data set. Specifically, due to the influence of external environmental factors, pedestrians may be under the shadow of various obstacles, and it is difficult to obtain a complete p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04
CPCG06N3/045G06F18/22G06F18/241G06F18/214
Inventor 张化祥高文博刘丽朱磊孙建德金圣开于治楼
Owner SHANDONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products