Human interaction action recognition method based on video

Abstract

The invention discloses a video-based human interaction action recognition method, which includes the following steps: S1: using the frame difference method to detect the moving target on the input video frame image; S2: performing feature extraction on the moving target obtained after processing, including : S21: Extract human interaction action features by combining local spatiotemporal features and global optical flow features from the processed moving objects; S22: Describe the optical flow and spatiotemporal interest points to form feature descriptors HOF and HOG ; S23; pass the local spatiotemporal features and global optical flow features through the BP neural network to obtain the probability matrix of the action category under a certain feature; S3: weighting by assigning different weights to the probability matrix obtained by using different features Sum to obtain the fusion probability matrix, and the action category with the highest probability is the action category of the frame; S4: Input the initial classification sequence into the improved normal distribution BP neural network to obtain the final interactive action classification.

Description

technical field [0001] The invention belongs to the field of computer vision and can be used for human body interaction posture or action analysis research. Background technique [0002] Vision-based human interaction analysis has always been one of the research hotspots in the field of computer vision, which not only has important theoretical significance, but also has broad application prospects. In the intelligent video surveillance system, due to the existence of phenomena such as "robbery" and "fighting", the importance of analyzing and understanding the interaction between people in the scene is particularly prominent; in the huge video database, human interaction Action recognition can automatically retrieve according to predefined action patterns, making it very convenient to retrieve specific events in video databases; virtual reality mainly uses computers to perform visual operations and simulations on complex data to create virtual simulation scenes, and based on ...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a video-based human interaction action for the existing human interaction action recognition method, which is difficult to effectively extract the features of human interaction actions and establish complex interaction models between multiple targets. Identification technology

Images