A 3D gesture motion reconstruction method and system

Abstract

The invention discloses a method and a system for restructuring the motion of a three-dimensional gesture. The method comprises the following steps of: performing region segmentation on a first frame image of an acquired gesture image sequence; generating an affine transformation matrix of each segmentation region; generating projection coefficient from three dimensions to two dimensions; obtaining a three-dimensional gesture model corresponding to the first frame image according to the projection coefficient and the affine transformation matrix; determining a framework node of the obtained three-dimensional gesture model corresponding to the first frame image and the freedom degree of the framework node; and performing simulated annealing particle filtering operation by combining the current frame image based on the framework node and the freedom degree of the framework node of the three-dimensional gesture model corresponding to a front frame image in allusion to follow frame imagesto obtain the three-dimensional gesture model of the current frame image, and thus realizing the restructuring of the three-dimensional gesture. According to the method and the system, the accurate modeling of a three-dimensional hand by using a laser scanner is not required, and the complexity of the motion restructuring process is reduced.

Description

technical field [0001] The invention relates to the fields of computer vision and computer graphics, and in particular, relates to a motion reconstruction technology of a three-dimensional gesture. Background technique [0002] Motion reconstruction of motor gestures has been a concern of researchers, because gestures usually play an important role in the communication of information between people. In virtual reality, the hand is a very important action and perception relationship model in the user model, and human behavior characteristics are an important research content of human-computer interaction. In the virtual environment, three-dimensional interactive tasks and technologies such as grasping and releasing objects, flying, roaming, and navigation are realized by hand. In the past, human-computer interaction was obtained by using human touch behavior and computer response. In the process of human-computer interaction, direct interaction with computer systems through ...

AI Technical Summary

Problems solved by technology

However, there are still the following problems: 1) The reconstruction work needs to obtain a relatively accurate 3D initial model; 2) The reconstruction work usually uses a local optimization algorithm to optimize in a small range, which is likely to fall into the situation of local extremum; 3) The reconstruction work Even if there is a globally optimized algorithm, the running time of the algorithm is usually long

Images