Video behavior identification method based on compression reward and punishment mechanism

Abstract

The invention belongs to the field of computer vision, and relates to a video behavior identification method based on a compression reward and punishment mechanism. The technical problems that an existing video behavior recognition method is large in calculated amount, poor in robustness, low in accuracy and the like are mainly solved. According to the invention, a convolutional neural network containing a compression reward and punishment mechanism is designed for video behavior identification. The network is constructed based on a time segmentation network. The method comprises the followingsteps: firstly, dividing a video into three segments, randomly extracting an optical flow image and an RGB frame from each segment, respectively inputting the optical flow image and the RGB frame into a time and space network, weighting the extracted features through compression and reward and punishment operations, and respectively carrying out preliminary prediction on behaviors of the weightedtime and space features on a time channel and a space channel; fusing the preliminary prediction result of each segment to obtain a video-level prediction result; and finally, fusing the video-levelprediction results to obtain a video behavior recognition result. Experiments are carried out on data sets UCF101 and HMDB51, and results show that compared with other models, the model has higher accuracy.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a video behavior recognition method based on a compression reward and punishment mechanism. Background technique [0002] Video behavior recognition is currently a hot spot in the field of computer vision, and its purpose is to automatically analyze ongoing behavior from a video or image sequence. [0003] Video behavior recognition is divided into traditional methods and methods based on deep learning. Traditional methods include dense trajectory algorithm and improved dense trajectory algorithm. The basic idea of ​​the dense trajectory algorithm is to use the optical flow field to obtain the trajectory in the video sequence, and then calculate the direction gradient histogram, optical flow direction histogram and other features along the trajectory; the improved dense trajectory algorithm uses the optical flow between two frames of video before and after. Streams an...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a video behavior recognition method based on a compression reward and punishment mechanism to solve the technical problems of large amount of calculation, poor robustness, inability to extract video motion information, and low accuracy in current video behavior recognition methods

Images