Gesture tracking method and device

A gesture and hand technology, applied in the field of image processing, can solve problems such as hand self-occlusion

Pending Publication Date: 2021-01-12
BEIJING HUAJIE IMI TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present application provides a gesture tracking method and

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture tracking method and device
  • Gesture tracking method and device
  • Gesture tracking method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] Explanation of terms:

[0067] Distance Transform: Distance Transform, referred to as DT.

[0068] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0069] see figure 1 , the present invention provides a mixed reality device. The mixed reality device includes a processor 100 , a memory 200 connected to the processor 100 and a binocular photographing component 300 .

[0070] The binocular shooting part 300 is a shooting device with two cameras, and there is a certain distance between the two cameras, so that the two cameras can sh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a gesture tracking method and device. The method comprises the steps: executing initialization operation on a three-dimensional hand model; performing projection operation on the three-dimensional hand model by utilizing the internal and external parameter sets of the binocular shooting component to obtain two digital images; performing distance transformation operation on the two digital images to obtain a second left-eye nearest neighbor index map and a second right-eye nearest neighbor index map; constructing a nonlinear optimization equation containing a main energyitem and a constraint energy item, and solving the nonlinear optimization equation to obtain a parameter adjustment step length of the hand three-dimensional model; and adjusting the three-dimensionalhand model based on the parameter adjustment step length. Due to the fact that the binocular shooting component can shoot the hand from different angles, the self-shielding area in one digital imagecan be displayed in the other digital image, and the problem of hand self-shielding can be solved through cooperation of the two digital images.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to a gesture tracking method and device. Background technique [0002] With the substantial improvement of mixed reality technology, mixed reality technology has been paid attention to and used in many fields. In the process of realizing the interaction between reality and virtual reality, the most direct way is through gesture interaction. Gesture tracking is an important technology to solve gesture changes. [0003] The commonly used gesture tracking technology is to combine depth sensors and monocular shooting components, specifically: use monocular shooting equipment to capture two-dimensional images including hands, and use depth sensors to perform depth map gesture tracking solutions on two-dimensional images, so as to obtain The 2D image is used to calculate the 3D hand pose data. [0004] Since a monocular shooting device is used to shoot two-dimensional ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
CPCG06V40/28G06V40/113
Inventor 彭博文李骊
Owner BEIJING HUAJIE IMI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap