Pedestrian re-recognition method and system based on deep learning and reinforcement learning

Abstract

The invention discloses a pedestrian re-recognition method and system based on deep learning and reinforcement learning. The pedestrian re-recognition method comprises the steps of receiving video and acquiring pedestrian pictures, wherein data of the pedestrian pictures comprises an identity tag and coordinate information, and calculating the movement direction of the same pedestrian in different pictures according to an optical flow algorithm and the pedestrian coordinate information so as to acquire pedestrian orientation data, wherein a pedestrian training data set contains the pedestrian identity tag and an orientation tag; building a deep neural network by using a multi-task learning method, and training a pedestrian orientation and identity recognition model; setting decision-making bases according to the orientation, setting decision-making categories according to combinations of different decision-making bases, forming a decision-making space by all of the decision-making categories, and training the decision-making categories in the decision-making space according to a preset reinforcement learning model so as to calculate an optimal decision-making model. When retrieval is performed on a pedestrian, the deep model is called to acquire orientation information, then the reinforcement learning model is called to acquire tan optimal decision-making scheme, and then pedestrians in the pedestrian library are compared so as to acquire a more accurate retrieval result. The pedestrian re-recognition method effectively utilizes the pedestrian orientation information to make a matching decision, so that the accuracy of pedestrian re-recognition is improved.

Description

technical field [0001] The invention belongs to the technical field of video surveillance, and in particular relates to a pedestrian re-identification method and system based on deep learning and reinforcement learning. Background technique [0002] In order to identify pedestrian identities in non-overlapping surveillance scenes from different viewpoints, person re-identification techniques have been widely developed, especially in the field of surveillance video. Since the same pedestrian in different monitoring scenarios has large differences in background, lighting, and orientation, how to solve the influence of factors such as background, illumination, and orientation, so as to quickly detect and track pedestrians is a technical problem that needs to be solved urgently. [0003] The existing pedestrian re-identification technology mainly has the following problems: [0004] Current research mainly focuses on how to better express features and how to better learn distan...

AI Technical Summary

Problems solved by technology

This kind of decision-making method relies on artificial design, and it can have a good effect on the fully considered orientation or appearance. However, the diversity of pedestrian appearance and orientation determines the complexity of the matching criteria, which also illustrates the shortcomings of this method.

Images