A motion classification method based on simple loop network and attention mechanism of joint space-time is proposed

Abstract

The invention relates to an action classification method based on a connection node spatio-temporal simple circulating network and an attention mechanism. Firstly, the space dimension of SRU model isextended, and an iterative computation method of ST-SRU model. Then, in the proposed ST-SRU model and global contextual attention mechanism, GCA-ST-SRU method. Finally, the proposed method is appliedto human behavior recognition. Firstly, the features of human joints are extracted by depth network, and then the human joints are extracted by GCA-ST-SRU method recognizes the extracted features. Themethod of the invention can reduce training time consumption and improve classification accuracy, and has obvious efficiency advantages. The method of the invention can quickly deduce the speed, which is favorable for the design of the real-time motion recognition system, and is suitable for running on the platform with limited computing power, and has wide application prospect in the fields of computer vision, intelligent monitoring, human-computer interaction and the like.

Description

technical field [0001] The invention belongs to the field of pattern recognition, and is a method for modeling actions represented by joint points by using a space-time simple loop network, and combining the advantages of an attention mechanism to classify actions. Background technique [0002] Action recognition is widely used in intelligent video surveillance, human-computer interaction, medical assistance, abnormal behavior detection and other fields. Action recognition refers to the classification of the behavior of characters in a video. A video can be decomposed into multiple consecutive pictures, so action recognition can also be regarded as a problem of classifying a sequence of pictures. A popular research direction of action recognition in recent years is to capture the three-dimensional space coordinates of body joint points when people are doing actions through sensors such as depth cameras, and then classify the sequence of human joint point coordinates. The coo...

AI Technical Summary

Problems solved by technology

[0006] The above methods have made good use of various recurrent network models to conduct research on behavior recognition based on human joints, but methods based on LSTM and GRU have a large number of calculations that depend on time series when processing sequences of human joints, and these calculations cannot finish independently

For example, when LSTM and GRU calculate the hidden state of the current time step, due to the dependence, they must first calculate the hidden state of the previous time step, which limits the speed of sequence processing. With the scale of the LSTM model and the number of hyperparameters The increase of the training time is getting longer and longer, and the adjustment of the parameters will also take more time

Images