Hand motion reconstruction method and device

Abstract

The present invention proposes a hand motion reconstruction method and device, wherein the method includes: acquiring a hand depth data set, wherein each hand depth data in the hand depth data set includes hand depth picture information and its corresponding Hand skeleton coordinates; control the preset hand model to adjust the posture according to each hand depth data in the hand depth data set, and obtain the posture parameters of the fitted hand model after posture adjustment; according to each hand depth data corresponding The Gaussian distribution function of the posture parameters of the fitting hand model is used to facilitate hand motion reconstruction according to the Gaussian distribution function. The present invention solves the technical problems in the prior art that human hand activities are relatively flexible and complicated, and the process of interacting with objects is often accompanied by serious occlusion. Through isomorphic single-viewpoint RGB‑D data, more accurate three-dimensional reconstruction results can be obtained. Better object and hand interaction reconstruction results can be obtained under simpler hardware conditions.

Description

technical field [0001] The present invention relates to the technical field of computer vision, in particular to a hand motion reconstruction method and device. Background technique [0002] In the field of 3D dynamic reconstruction, 3D reconstruction of human hand is a very hot issue. Due to the complex and flexible movements of human hands and often accompanied by self-occlusion problems, accurate hand dynamic reconstruction is very challenging. As the hand is the main way for people to physically contact with the outside world, hand reconstruction has great applications in virtual reality, human-computer interaction and other fields. [0003] Usually, people interact with the outside world all the time, the most frequent of which is the physical interaction between the hand and the outside world. If we can better reconstruct the interaction process between the hand and the outside world, it will be of great help to understand the deep meaning of the interaction between ...

AI Technical Summary

Problems solved by technology

However, the activities of the human hand are more flexible and complex, and the process of interacting with objects is often accompanied by very serious occlusion problems. How to reconstruct the interaction between the hand and the outside world from a single viewpoint is a challenging problem.

Images