Gesture tracking method for VR headset device and VR headset device

A head-mounted device and gesture technology, applied in the field of virtual reality, can solve the problems of inaccurate tracking gesture coordinates, ineffective use of three-dimensional space structure, and large data errors, etc., to achieve long-distance multiple hand command control, The effect of eliminating errors and improving accuracy

Active Publication Date: 2017-05-10
GEER TECH CO LTD
View PDF3 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that the three-dimensional structure of the hand has not been effectively utilized during the image acquisition of the existing VR head-mo...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture tracking method for VR headset device and VR headset device
  • Gesture tracking method for VR headset device and VR headset device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0041] see figure 1 Shown is a schematic flowchart of an embodiment of a gesture tracking method for a VR head-mounted device disclosed in the present invention. Specifically, the tracking method disclosed in this embodiment includes several steps such as image preprocessing, three-dimensional feature extraction, building convolutional neural net...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a gesture tracking method for a VR headset device, which comprises the following steps of: acquiring a plurality of training images; separating hand depth images; marking a three-dimensional gesture, and forming original point cloud; calculating a normal vector and a curvature, and carrying out mean removing normalization; setting up a CNN network, wherein an input end of the CNN network is used for respectively inputting multiple normal vectors, curvatures and hand depth images, and an output end of the CNN network is used for outputting three-dimensional coordinates of a plurality of joint points including a palm center; using the trained CNN network as a feature extractor of the three-dimensional gesture, acquiring real-time action depth images by a depth camera, extracting and processing normal vector, curvature and hand depth image information of the three-dimensional gesture which the real-time action depth images comprise by the feature extractor, outputting the three-dimensional coordinates of a plurality of joint points including the palm center, and carrying out tracking on the identified three-dimensional gesture. The invention further discloses a VR headset device. The gesture tracking method and the VR headset device which are provided by the invention fuse three-dimensional feature information, and have the advantage of high model identification rate.

Description

technical field [0001] The present invention relates to the technical field of virtual reality, in particular to a gesture tracking method for a VR head-mounted device and the VR head-mounted device. Background technique [0002] Virtual reality technology is an important branch direction of simulation technology. Virtual reality technology uses computers, related technologies and software and hardware tools to generate real-time dynamic, three-dimensional and textured images and scenes, and enables it to imitate various human perceptions and interact with users using sensors. Since the emergence of virtual reality technology in 1963, the theory of virtual reality technology has been relatively perfect, and in recent years, virtual reality technology has been widely and deeply researched and used in military simulation, entertainment games, medical treatment, construction and other industries. [0003] In the human-computer interaction process of the existing virtual realit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/017G06V40/28
Inventor 仇璐张绍谦张超
Owner GEER TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap