Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Pedestrian re-identification method and device based on residual attention mechanism space-time joint model

A technology of pedestrian re-identification and attention mechanism, which is applied in the field of pedestrian re-identification based on the spatio-temporal joint model of residual attention mechanism, can solve the problem of ignoring the temporal and spatial information of image time series, and achieve the effect of accelerated convergence and high precision

Active Publication Date: 2020-05-15
WUHAN UNIV
View PDF8 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most of the existing methods to solve the pedestrian re-identification problem only use the pedestrian identity information in the tag, and ignore the spatio-temporal information such as the camera ID information, the time sequence of the image, and the frame number of the image in the video, which are easier to collect.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian re-identification method and device based on residual attention mechanism space-time joint model
  • Pedestrian re-identification method and device based on residual attention mechanism space-time joint model
  • Pedestrian re-identification method and device based on residual attention mechanism space-time joint model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0053] The embodiment of the present invention provides a pedestrian re-identification method based on the spatiotemporal joint model of the residual attention mechanism. The environment is PyTorch 1.1.0, Python 3.5, CUDA9.0 and CUDNN7.1. During specific implementation, a corresponding environment may be set as required.

[0054] Embodiments of the present invention provide a pedestrian re-identification method based on the residual attention mechanism spatio-temporal joint model, see figure 1 , the implementation process includes the following specific steps:

[0055] In step a, feature extraction is performed on the input pedestrian x through the ResNet-50 model pre-trained by the ImageNet dataset, and the feature matrix is ​​denoted as f.

[0056] Wherein, the ImageNet data set is a public data set, and the ResNet-50 mod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a pedestrian re-identification method and system based on a residual attention mechanism space-time joint model. The pedestrian re-identification method comprises the steps of performing feature extraction on an input pedestrian through a pre-trained ResNet-50 model; constructing a residual attention mechanism network, wherein a residual attention mechanism network comprisesa residual attention mechanism module, a feature sampling layer, a global pooling layer and a local feature connection layer; according to the trained residual attention mechanism network, using cosine distance to calculate a characteristic distance and recording the characteristic distance as a visual probability; performing modeling according to a camera ID and the frame number information space-time probability in the training sample pedestrian label, and performing Laplace smoothing processing on a probability model to acquire a pedestrian re-identification result by utilizing the visualprobability, the space-time probability and the final joint space-time probability. The pedestrian re-identification method based on the Bayesian joint probability solves the problem that an existingmethod ignores time and space prior information in a camera network, optimizes network iteration by using an attention residual mechanism network, accelerates convergence, and enables pedestrian re-identification precision to be higher through optimized Bayesian joint probability solution.

Description

technical field [0001] The invention belongs to the technical field of pedestrian re-identification, and relates to a pedestrian re-identification method and device based on a residual attention mechanism spatio-temporal joint model. Background technique [0002] Surveillance video is usually unable to obtain very high-quality face pictures due to the camera resolution and shooting angle, and pedestrians often show multi-scale characteristics, making detection and recognition difficult. At this time, pedestrian re-identification has become a very important alternative technology . Pedestrian re-identification is to achieve cross-device retrieval through a given monitored pedestrian image, which can effectively compensate for the visual limitations of fixed-view cameras, and has important application value in the fields of video surveillance, intelligent security, and smart cities. [0003] In recent years, with the development of machine learning theory, methods based on de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/10G06N3/045G06V40/23G06V20/46G06V20/52G06V10/454G06V10/82G06F17/18G06V40/103G06F18/2321G06F18/24155
Inventor 邵振峰汪家明
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products