Human behavior recognition method based on multi-feature fusion

Abstract

The invention relates to a human behavior identification method based on multi-feature fusion, which comprises the following steps of: acquiring a human body behavior video by using a camera, extracting a foreground image of each frame of image, and carrying out cavity filling and interference filtering to obtain a human body silhouette image sequence; Calculating the similarity between adjacent frames in the image sequence, and obtaining the weight of each frame of image representing the behavior posture; According to each frame of image in the human body silhouette image sequence and the corresponding weight thereof, obtaining an action energy diagram representing a behavior process through weighted average; And extracting a Zernike moment, a gray histogram and a texture feature of the action energy diagram to form a multi-dimensional feature fusion vector containing behavior space-time characteristics; Constructing feature vector template libraries of different standard behaviors; And in the behavior identification process, extracting feature vectors of to-be-identified behaviors according to the to-be-identified videos, matching the feature vectors of the to-be-identified behaviors with the feature vectors of the standard behavior template library one by one, determining behavior types according to matching results, and realizing accurate identification of human body behaviors. According to the method, the time change and spatial attitude characteristics of human body behaviors are represented by constructing the action energy diagram, the behavior recognition accuracyand real-time performance can be improved, and certain practical value is achieved.

Description

technical field [0001] The invention relates to a computer vision and image processing method, in particular to a multi-feature fusion human behavior recognition method. Background technique [0002] Human behavior recognition is an important branch of computer vision. It refers to the use of pattern recognition, machine learning and other methods to automatically analyze and recognize the human body's actions from an unknown video. It can be widely used in intelligent security, traffic management, intelligent robots, and intelligent care. , entertainment and leisure and other real life fields. [0003] At present, human body behavior recognition can be divided into two methods based on sensors and vision. Among them, sensor-based behavior recognition needs to wear corresponding sensors on the joints of the human body, which has problems such as cumbersome operation, inflexibility, and poor user experience, so it can only be applied. Behavior recognition based on vision can...

AI Technical Summary

Problems solved by technology

[0003] At present, human body behavior recognition can be divided into two methods based on sensors and vision. Among them, sensor-based behavior recognition needs to wear corresponding sensors on the joints of the human body, which has problems such as cumbersome operation, inflexibility, and poor user experience, so it can only be applied. Behavior recognition based on vision can be divided into recognition based on single-frame image and video. Behavior recognition based on single-frame image cannot effectively obtain the time information of the behavior, and its recognition effect is poor. Behavior recognition based on video It can use the spatiotemporal information in the video, and its accuracy is relatively high. At present, it mainly uses joint skeleton features, cyclic neural network models, 3D convolutional network learning models, etc. for video behavior recognition. However, the current mainstream deep learning methods have algorithmic complexity. Higher, high requirements on hardware, and because human behaviors are relatively random and unpredictable in terms of time duration and spatial posture, the posture and movement speed of the same behavior may be different, and the behavior of different people There are also certain differences in the range of motion and so on. Currently, there is a lack of effective unsupervised learning or semi-supervised learning methods, and it is still extremely dependent on massive behavioral data.

Images