Video pedestrian re-identification algorithm and device based on multi-space-time attention model

An attention model and pedestrian re-identification technology, applied in the field of computer vision, can solve problems such as increasing the amount of calculation of the system, deteriorating system robustness, and affecting the accuracy of pedestrian re-identification, so as to improve the accuracy of re-identification and improve the robustness. sticky effect

Active Publication Date: 2019-08-09
SHENZHEN JIULING SOFTWARE TECH CO LTD
View PDF7 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In practice, pedestrians are often partially occluded, which destroys the extracted features
And video-based pedestrian re-identification Re-ID, if all the frames are used, there will be a lot of poor quality pictures (occlusion, lighting and other factors) that will have a great impact on the features of deep learning
Thus affecting the accuracy of pedestrian re-identification, increasing the amount of calculation of the system and deteriorating the robustness of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video pedestrian re-identification algorithm and device based on multi-space-time attention model
  • Video pedestrian re-identification algorithm and device based on multi-space-time attention model
  • Video pedestrian re-identification algorithm and device based on multi-space-time attention model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0049] The flow chart of algorithm of the present invention is as figure 1 As shown, the overall network structure diagram is as follows figure 2 shown.

[0050] The video pedestrian re-identification algorithm based on the multi-temporal and spatial attention model proposed by the present invention specifically includes the following steps:

[0051] S1 locates and discriminates pedestrian areas in video images based on a multi-spatial attention model;

[0052] S1.1 Use a constrained random sampling strategy to sample video images;

[0053] The present invention proposes a constrained random sampling strategy in order to obtain a good feature expression of the original data. This method can utilize the visual information of the entire video sequence while avoiding redundancy between consecutive frames. The details...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video pedestrian re-identification algorithm and device based on a multi-space-time attention model. The algorithm comprises: firstly, using a multi-space attention model forpositioning and distinguishing a video image pedestrian area; calculating the aggregate representation of the features extracted by each spatial attention model in combination with the time attentionmodel, and carrying out pedestrian re-identification loss function compensation; and finally comparing the feature vector of the to-be-identified image with the feature vector of the pedestrian of the video image in the effective geographic area range, searching the pedestrian target image with the highest similarity, and outputting a final re-identification matching result. The algorithm can solve the problems that in the actual process, the pedestrian video image imaging quality is poor, detail display is not clear, useful information of a pedestrian part is blocked, feature extraction is difficult, and consequently the video monitoring system is not high in re-identification accuracy, and the algorithm meets the real-time requirement.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to a video pedestrian re-identification algorithm and device based on a multi-temporal-spatial attention model. Background technique [0002] With the continuous development of artificial intelligence, computer vision and hardware technology, video image processing technology has been widely used in smart city systems. [0003] Person re-identification (Person Re-identification) is also called person re-identification, or Re-ID for short. It is a technology that uses computer vision technology to judge whether there is a specific pedestrian in an image or video sequence. In surveillance video, due to camera resolution and shooting angle, it is usually impossible to obtain very high-quality face pictures. When face recognition fails, Re-ID becomes a very important substitute technology. A very important feature of Re-ID is cross-camera, so retrieving the same pedestrian pictures und...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04
CPCG06V40/10G06V20/46G06N3/045G06F18/214Y02T10/40
Inventor 张斯尧谢喜林王思远黄晋蒋杰张诚
Owner SHENZHEN JIULING SOFTWARE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products