Video pedestrian re-identification method based on region guidance and space-time attention

Abstract

The invention discloses a video pedestrian re-identification method based on region guidance and space-time attention, and the method comprises the steps: firstly constructing global features, calculating the global features extracted by each frame in a video stream based on a time attention model, and carrying out aggregation to obtain a global feature vector; constructing region features, horizontally dividing the extracted pedestrian depth feature map into four blocks, generating respective guide frames of the four regions through a key frame generation layer to extract the corresponding region features, and performing calculation in combination with a space-time attention model to obtain a region feature vector; wherein the feature vector of the to-be-identified pedestrian video streamis obtained by combining the global feature vector and the regional feature vector, and is compared with the feature vector of the pedestrian in the video image of the selected geographic region to obtain the pedestrian target video stream with the minimum distance and output a final re-identification matching result. The method can solve the problems of poor pedestrian video image imaging quality, serious detail loss, pedestrian part loss and low video pedestrian re-identification accuracy caused by feature extraction difficulty.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to a video pedestrian re-identification method based on region guidance and spatio-temporal attention. Background technique [0002] With the continuous development of artificial intelligence, computer vision and hardware technology, video image processing technology has been widely used in smart city systems and public security systems. [0003] Person re-identification technology (Person Re-identification) is also called pedestrian re-retrieval, or Re-ID for short. This is a technology that uses computer vision technology to determine whether a specific pedestrian exists in an image or video sequence. Generally, in the monitoring video captured by the monitoring camera, it is difficult to obtain high-quality and clear face pictures because the resolution of the camera is generally low. At this time, face recognition may fail, so Re-ID has become a very important substitute technol...

AI Technical Summary

Problems solved by technology

[0005] The present invention proposes a video pedestrian re-identification method based on area guidance and spatio-temporal attention, which can use the key frames in each area in the video stream to guide the extraction of feature vectors, and solve the problem of poor imaging quality of pedestrian video images and serious loss of details in the actual process. It can effectively resist part occlusion and misalignment, use the spatio-temporal attention mechanism to effectively extract temporal and spatial information in video sequences, improve the accuracy of re-identification under complex conditions, and improve the robustness of the system

Images