The invention belongs to the field of
human behavior recognition and
computer vision, and provides a
human behavior recognition method and device based on an improved space-time diagram
convolutional neural network. The method relates to a graph
neural network modeling technology and a spatial-temporal
feature extraction technology. The method comprises the following steps: firstly, acquiring an original
human body behavior video through a video acquisition
system, and converting the original
human body behavior video into a fixed-length
image frame sequence; extracting
human skeleton key point coordinates and confidence based on a YOLOv8-
pose algorithm, and constructing a
time sequence skeleton graph structure; screening skeleton targets with relatively high confidence coefficients to serve as skeleton
feature data; the method comprises the following steps of: constructing a
skeleton graph structure and a joint
feature matrix on a space structure, automatically dividing the graph structure by utilizing a Laplacian
feature mapping method, and extracting local and global features; in a
time domain, a multi-scale cavity
convolution method is adopted to extract
human body action change trends with different time lengths; and finally, space and time dimension information is fused, and recognition and classification of behavior categories are completed. The human body
behavior recognition method based on the improved space-time diagram
convolutional neural network has the advantages of being clear in structure, easy to deploy, high in parameter automatic optimization capacity, suitable for various complex human body action scenes and the like, and meets the dual requirements for recognition precision and real-time performance in practical application.