Video-based behavior recognition method, device, electronic device and storage medium

Abstract

Embodiments of the present invention provide a video-based behavior recognition method, device, electronic equipment, and storage medium, wherein the method includes: determining the image sequence of the video to be recognized; inputting the image sequence into the behavior recognition model to obtain the behavior output by the behavior recognition model Recognition results; the behavior recognition model is trained based on the sample image sequence of the sample video and the sample behavior recognition results; wherein, the behavior recognition model is used to encode the image features, time features and motion features of the continuous images in the image sequence to obtain continuous The spatio-temporal features of images, and behavior recognition based on the spatio-temporal features of continuous images, temporal features and motion features are determined based on the image features of continuous images. The method, device, electronic equipment, and storage medium provided by the embodiments of the present invention greatly reduce the calculation amount of spatio-temporal feature encoding and improve the efficiency of behavior recognition while ensuring high-precision behavior recognition.

Description

technical field [0001] The present invention relates to the technical field of computer vision, in particular to a video-based behavior recognition method, device, electronic equipment and storage medium. Background technique [0002] With the enhancement of computer processing power, video-based behavior recognition technology emerges at the historic moment, and has broad application prospects in video surveillance, robotics and other fields. [0003] At present, most video-based behavior recognition methods are implemented based on Convolutional Neural Networks (CNN). Among them, 3D CNN can learn the spatial-temporal feature expression from the original video, but the calculation of the spatio-temporal feature expression has the problems of large amount of calculation and long inference time, which makes it difficult to put into practical application. Contents of the invention [0004] Embodiments of the present invention provide a video-based behavior recognition metho...

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a video-based behavior recognition method, device, electronic equipment, and storage medium to solve the problems of large computation and long reasoning time in existing video-based behavior recognition

Images