Network training method and device, action recognition method and device, equipment and storage medium

Abstract

The invention provides a network training method and device, an action recognition method and device, equipment and a computer readable storage medium. The method comprises the following steps: updating model parameters of a pre-training model by utilizing a first sequence data set of a human skeleton point sequence and a visual angle label corresponding to each piece of first sequence data in thefirst sequence data set; initializing model parameters of a human body action recognition model based on the updated model parameters of the pre-trained model; wherein the pre-training model and thehuman body action recognition model have feature extraction networks with the same structure; and updating model parameters of the human body action recognition model by utilizing the second sequencedata set of the human body skeleton point sequence and the action category label corresponding to each second sequence data in the second sequence data set to obtain a trained human body action recognition model. Through the method and the device, the action recognition precision of the human body action recognition model can be improved, the model training time can be reduced, the dependence on strong annotation data can be reduced, and the manual workload is further reduced.

Description

technical field [0001] The present application relates to computer vision technology, in particular to a method, device, device and storage medium for network training and action recognition. Background technique [0002] With the research and progress of artificial intelligence technology, artificial intelligence technology has been researched and applied in many fields, such as common smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, unmanned driving, automatic driving, drones , robots, smart medical care, smart customer service, etc. In the application of artificial intelligence technology, the application of human action recognition technology is playing an increasingly important role, such as detecting whether the target person falls or is sick, automatic teaching of fitness, sports and dance, etc., understanding body language (such as Airport runway signals, traffic police signals, etc.), enhanced security and monitoring, etc. ...

AI Technical Summary

Problems solved by technology

In related technologies, since the visibility of the key points of the human skeleton is greatly affected by the posture of the human body and environmental factors, there will be a certain amount of noise in the sequence of human skeleton points estimated by the sensor, which will interfere with subsequent action recognition.

Images