Action Recognition Method Based on Segmented Body Model Applied in Human-Machine Collaboration

Abstract

The invention relates to an action recognition method based on a segmented human body model applied in human-computer cooperation. The Microsoft Kinect V2 sensor is used to collect human skeleton information to obtain joint node coordinates; after preprocessing, the skeleton node sequence is mapped from four dimensions to three dimensions, Stored in the form of a point cloud sequence; divide the human body model into three parts: upper limbs, lower limbs and torso, extract feature vectors and Boolean value feature matrices of relative positions of joint points respectively, use Boolean value feature matrices to extract key frames respectively, use feature vectors and The dynamic time warping algorithm (DTW algorithm) performs template matching separately; finally, the recognition results of the three parts are combined to obtain the classification of the overall movement of the human body. The present invention can not only achieve the purpose of recognizing the overall movement of the human body, but also obtain the movement description of the upper limbs, torso and lower limbs of the human body, and can identify human movements and behaviors in more detail and accurately, so as to help robots under human-machine cooperation to perform subsequent tasks planning.

Description

technical field [0001] The invention belongs to the field of human-computer interaction, and relates to an action recognition method based on a segmented human body model applied in human-computer cooperation. Background technique [0002] With the development of robot technology, the application scenarios of robots are becoming wider and wider, and there are more and more intersections and integrations with other fields. At the same time, there are many scenarios that require collaborative operations between humans and robots. The collaborative operation of robots and humans can not only liberate human labor, but also help humans avoid high-risk operational tasks at certain times. Human-machine cooperation is one of the future development directions of intelligent robots in the future. [0003] Human-machine collaboration emphasizes the leading role of humans. It should enable robots to understand human intentions as accurately as possible under the premise of ensuring saf...

AI Technical Summary

Problems solved by technology

[0004] However, human actions have the characteristics of high complexity, large amount of information, different users may have differences in the same action, different actions may have repetitive gestures, and may have meaningless actions, etc., which makes the recognition of human actions difficult. Big, is a cross topic involving computer vision, pattern recognition, artificial intelligence and other fields

Images