A joint gesture tracking and recognition strategy for deskVR is proposed

A gesture, strategy technique

Active Publication Date: 2019-02-19
ZHEJIANG UNIV OF TECH
View PDF10 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Current gesture recognition methods still struggle to accurately identify joint positions under large occluded regions
3) Easy fatigue: desktop VR experience requires users to wear VR equipment
Traditional m

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A joint gesture tracking and recognition strategy for deskVR is proposed
  • A joint gesture tracking and recognition strategy for deskVR is proposed
  • A joint gesture tracking and recognition strategy for deskVR is proposed

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0066] Such as figure 1 As shown, a joint strategy method for gesture tracking and recognition for deskVR specifically includes the following steps:

[0067] Training CNN model stage.

[0068] S01: Get the dataset and preprocess it. The public dataset ICVL is used for model training. According to the contour processing function in opencv, detect and draw its outer contour according to the binary image of the hand. According to the Douglas-Pocke algorithm, find the closed polygon of the contour. Determine the center of the closed polygon, and extract a cube with a size of 150mm centered on the center of the area. The cube is then resized to a 96×96 image, and the depth values ​​are normalized to [-1,1] as the input to the ConvNet.

[0069] S02: Construct a convolutional neural network, the specific structure is: a five-region con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a gesture tracking recognition joint strategy method oriented to deskVR, At first, that hand gesture public data set ICVL is train offline by the convolution neural network, get a good robustness, models with high accuracy and fast recognition speed, and by testing the balance point Rate of accuracy and speed of the combined method with synthetic data, Then the depth imagesare captured by the depth camera in real time. After a series of preprocessing, the images are transferred into the gesture recognition method based on the fast model or the five-region convolution neural network model according to the proportion of the hand images, and the 3D information of the recognized joints is returned, and then the 3D human body model is mapped. The recognition method of the invention has good interactive function under the deskVR application environment, and performs well in recognition rate, operation speed, universality, accuracy and the like.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and in particular relates to a joint strategy method for gesture tracking and recognition facing deskVR. Background technique [0002] The poster child for immersive applications is desktop VR. It can be widely used for data analysis, watching VR movies. These applications typically provide stereo vision and head tracking, while they also need to provide gesture recognition for human-computer interaction. Sitting in a chair and resting your elbows on a table enables long gesture interactions in a VR environment. Because head-mounted displays (HMDs) block the eyes from viewing the real world, mice and keyboards are no longer suitable for immersive virtual environments. Joysticks are the most mature solution at the lowest cost, however the user has no direct control. [0003] Currently, gesture sensors on the market, including Leap Motion, use "HMD + gesture sensor" to achiev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/20G06N3/045
Inventor 卢书芳蔡历丁雪峰高飞毛家发
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap