Video-based human body behavior recognition method, device and equipment and storage medium

Abstract

The invention discloses a video-based human body behavior recognition method, apparatus and device, and a storage medium, and relates to the technical field of human body recognition. According to thespecific implementation scheme, a human body frame of each video frame of a to-be-identified video is acquired, each human body frame comprises a plurality of human body key points, and each human body key point has a key point feature; constructing a feature matrix according to the human body frame of each video frame; convolution is carried out on the feature matrix in the dimension of the number of video frames to obtain a first convolution result, and convolution is carried out on the feature matrix in the dimension of the number of key points to obtain a second convolution result; and inputting the first convolution result and the second convolution result into a preset classification model to obtain a human body behavior category of the to-be-identified video. The relation between the video frames of the front and rear frames is considered, the understanding deviation of the video can be reduced, and the accuracy and recall rate of the human body behavior category of the video are improved.

Description

technical field [0001] The present application relates to human body recognition technology in the field of image processing technology, and in particular to a video-based human body behavior recognition method, device, equipment and storage medium. Background technique [0002] With the development of video and image technology, human objects in the video can be detected, and then the behavior type of the human objects can be determined, so as to determine whether unsafe behaviors are being carried out. [0003] In the prior art, when the video technology is used to analyze the behavior type of the human object, the behavior of the human object in the video can be determined based on the characteristics of the human object in a certain frame. [0004] However, in the prior art, the behavior of the human object in the video is only confirmed based on the characteristics of the human object on one frame, and then the behavior type of the human object in the video is obtained;...

AI Technical Summary

Problems solved by technology

[0004] However, in the prior art, the behavior of the human object in the video is only confirmed based on the characteristics of the human object on one frame, and then the behavior type of the human object in the video is obtained; The semantics are different, the existing methods are not accurate, and cannot accurately identify the behavior type of the human body in a video

Images