Hand posture estimation and tracking method based on depth data

A hand posture and hand technology, applied in the field of hand motion posture estimation and tracking, can solve the problems of multi-computing resources and time, manual marking time-consuming and labor-intensive, and restricting accuracy, so as to achieve high computing efficiency, save computing resources and Time and real-time effects

Active Publication Date: 2019-09-27
HUAZHONG NORMAL UNIV
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the current hand posture tracking research, the hybrid method based on the advantages of learning [3] and generative model [4] can take into account both the efficiency and the robustness of the algorithm. It is the current hand motion posture estimation and tracking research However, under the framework of the hybrid method [5], how to use the semi-supervised method to solve the difficulties faced by the learning-based method, such as the large hand pose sample space and the time-consuming and labor-intensive manual labeling, is a problem that needs to be solved at present.
[0003] Therefore, the present invention mainly solves the following two problems: (1) There are a large number of local micro-movements in the learner's hand behavior in the experimental environment, and accurately capturing these micro-moveme

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hand posture estimation and tracking method based on depth data
  • Hand posture estimation and tracking method based on depth data
  • Hand posture estimation and tracking method based on depth data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0055] like figure 2 As shown, the present invention provides a method for hand pose estimation and tracking based on a depth image. The depth image of the hand obtained by a depth sensor uses a semi-supervised combination of a variational autoencoder (VAE) and a generative confrontation network (GAN). The hand pose estimation method obtains the hand parameter estimation, and then uses the gesture tracking method based on the signed distance function (SDF) to obtain the hand movement parameterized time series data; the specific implementation steps are as follows:

[0056] Step 1, a semi-supervised hand pose estimation method combining VAE and GAN. This method uses the characteristics that VAE can accurately approximate the real distribution of input variables to encode the input gesture depth image, and uses the discriminato...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hand posture estimation and tracking method based on depth data. According to the method, the hand parameter estimation is obtained through a hand depth image obtained through a depth sensor and by using a semi-supervised hand posture estimation method combining a variational autoencoder (VAE) and a generative adversarial network (GAN), and then the hand action parameterization time series data is obtained by using a gesture tracking method based on a symbolic distance function (SDF). In the practical application, the method is high in calculation efficiency and strong in real-time performance of posture estimation, can obtain a gesture estimation result with higher precision and the hand rapid tracking with better robustness under the constraint of a small number of labeled samples and a large number of non-labeled samples, and the calculation resources and the time can be saved.

Description

technical field [0001] The present invention relates to a hand motion posture estimation and tracking method, in particular to a hand motion posture estimation based on depth data, which is mainly applicable to various applications in the field of human-computer interaction. Background technique [0002] Early hand motion tracking mainly includes methods based on wearable devices and methods based on vision. The most typical representative device for hand posture tracking based on wearable devices is the data glove. The sensors in the glove convert the relevant posture and motion information of the hand into electrical signals and send them to the computer for processing. Although the data glove-based method has the advantages of being fast and accurate, this method requires the user to wear complex data gloves and position trackers, which do not meet the requirements of natural human-computer interaction, and the data gloves are expensive and are currently only suitable for...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06T7/73G06K9/00
CPCG06F3/017G06T7/75G06V40/28
Inventor 杨梦婷姚璜魏艳涛张羽
Owner HUAZHONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap