Human skeleton-oriented motion prediction method and system

Abstract

The invention provides a human skeleton-oriented motion prediction method and system. The method comprises the following steps: a data acquisition step: acquiring human skeleton data; a human body multi-scale map construction step: constructing a multi-scale human body according to the human body skeleton data, and constructing a human body multi-scale map by taking body parts as points and relationships among the parts as edges based on the multi-scale human body; a human body motion feature extraction step: introducing the human body multi-scale map into a depth model formed by spatial multi-scale map convolution, and extracting the comprehensive action semantic information of the multi-scale human body; and an action analysis and prediction step: realizing action prediction according tothe comprehensive action semantic information. According to the method, the high-level semantic information of the action can be extracted by utilizing the self-adaptive and dynamic graph structure and the DMGNN, and the action prediction is realized by utilizing the high-level semantic information.

Description

technical field [0001] The present invention relates to the field of video analysis and pattern recognition, in particular to a motion prediction method and system for human skeleton. In particular, it relates to a dynamic multi-scale graph neural network model and method for human skeleton motion prediction. Background technique [0002] Human motion understanding and prediction has a wide range of applications in video surveillance, human-computer interaction, and virtual reality. Among them, skeletal motion is an expression of human motion, which can be captured by a kinematic camera and represented as a series of joints and bones. Skeleton data can effectively express actions, and has the advantages of strong anti-noise ability and low data dimension. Action recognition using skeletal data has a wide range of applications. [0003] The current method of human skeleton action prediction usually considers the motion characteristics of each joint point independently, and...

AI Technical Summary

Problems solved by technology

However, during the movement of the human body, there is an interdependent relationship between different body parts, and these methods cannot explicitly mine the motion dependence between body parts.

Images