Hand motion reconstruction method and device

Abstract

The invention provides a hand motion reconstruction method and device, and the method comprises the steps: obtaining a hand depth data set, wherein each hand depth data in the hand depth data set comprises hand depth picture information and a corresponding hand skeleton coordinate; controlling a preset hand model to adjust the posture according to each hand depth data in the hand depth data set, and obtaining posture parameters of the fitting hand model after posture adjustment; and according to the attitude parameter Gaussian distribution function of the fitting hand model corresponding to each hand depth data, carrying out hand motion reconstruction according to the Gaussian distribution function. the technical problems that motion of hands is flexible and complex, serious shielding often occurs in the process of interacting with an object in the prior art can be solved, a more accurate three-dimensional reconstruction result can be obtained through isomorphic single-viewpoint RGB-Ddata, and a better object and hand interaction reconstruction result can be obtained under a simpler hardware condition.

Description

technical field [0001] The present invention relates to the technical field of computer vision, in particular to a hand motion reconstruction method and device. Background technique [0002] In the field of 3D dynamic reconstruction, 3D reconstruction of human hand is a very hot issue. Due to the complex and flexible movements of human hands and often accompanied by self-occlusion problems, accurate hand dynamic reconstruction is very challenging. As the hand is the main way for people to physically contact with the outside world, hand reconstruction has great applications in virtual reality, human-computer interaction and other fields. [0003] Usually, people interact with the outside world all the time, the most frequent of which is the physical interaction between the hand and the outside world. If we can better reconstruct the interaction process between the hand and the outside world, it will be of great help to understand the deep meaning of the interaction between ...

AI Technical Summary

Problems solved by technology

However, the activities of the human hand are more flexible and complex, and the process of interacting with objects is often accompanied by very serious occlusion problems. How to reconstruct the interaction between the hand and the outside world from a single viewpoint is a challenging problem.

Images