Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A gesture tracking method for a VR head-mounted device and the VR head-mounted device

A head-mounted device and gesture technology, applied in the field of virtual reality, can solve the problems of ineffective use of three-dimensional space three-dimensional structure, inaccurate coordinates of tracking gestures, large data errors, etc., to achieve long-distance multiple hand command control, Improve the training effect and eliminate the error effect

Active Publication Date: 2019-09-27
GEER TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that the three-dimensional structure of the hand has not been effectively utilized during the image acquisition of the existing VR head-mounted equipment, resulting in large data errors and inaccurate tracking gesture coordinates, the present invention discloses a gesture for VR head-mounted equipment tracking method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A gesture tracking method for a VR head-mounted device and the VR head-mounted device
  • A gesture tracking method for a VR head-mounted device and the VR head-mounted device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0041] see figure 1 Shown is a schematic flowchart of an embodiment of a gesture tracking method for a VR head-mounted device disclosed in the present invention. Specifically, the tracking method disclosed in this embodiment includes several steps such as image preprocessing, three-dimensional feature extraction, building convolutional neural net...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a gesture tracking method for a VR head-mounted device, comprising the following steps: collecting a plurality of training images; separating hand depth images; marking three-dimensional gestures to form an original point cloud; calculating normal vectors and curvatures, and de-mean normalization ; Build a CNN network. The input of the CNN network inputs multi-normal vectors, curvature and hand depth images respectively, and the output end outputs the three-dimensional coordinates of multiple joint points including the palm; the trained CNN network is used as a feature extraction of three-dimensional gestures The device collects real-time action depth images through the depth camera, and the feature extractor extracts and processes the normal vector, curvature and hand depth image information of the three-dimensional gestures contained in the real-time action depth image, and outputs the three-dimensional coordinates of multiple joint points including the palm , and track the recognized 3D gestures. Also disclosed is a VR headset. The invention integrates three-dimensional feature information and has the advantage of high model recognition rate.

Description

technical field [0001] The present invention relates to the technical field of virtual reality, in particular to a gesture tracking method for a VR head-mounted device and the VR head-mounted device. Background technique [0002] Virtual reality technology is an important branch direction of simulation technology. Virtual reality technology uses computers, related technologies and software and hardware tools to generate real-time dynamic, three-dimensional and textured images and scenes, and enables it to imitate various human perceptions and interact with users using sensors. Since the emergence of virtual reality technology in 1963, the theory of virtual reality technology has been relatively perfect, and in recent years, virtual reality technology has been widely and deeply researched and used in military simulation, entertainment games, medical treatment, construction and other industries. [0003] In the human-computer interaction process of the existing virtual realit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/017G06V40/28
Inventor 仇璐张绍谦张超
Owner GEER TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com