Gesture recognition and control method and device and virtual reality equipment

A gesture recognition and virtual reality technology, applied in the field of gesture recognition and control, can solve the problems of poor immersion experience, cumbersome tracker, inability to control and interact with virtual controls, etc., achieve natural interaction, improve accuracy, and enhance immersion experience Effect

Active Publication Date: 2021-08-10
QINGDAO PICO TECH CO LTD
View PDF12 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, in the virtual reality system, the interaction method of controlling the virtual control through the handle control tracker is not natural enough, especially in some special scenarios, the control and interaction o...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture recognition and control method and device and virtual reality equipment
  • Gesture recognition and control method and device and virtual reality equipment
  • Gesture recognition and control method and device and virtual reality equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0068] figure 1 It is a schematic flowchart of a gesture recognition method for a virtual reality device according to an embodiment of the present disclosure.

[0069] according to figure 1 As shown, the gesture recognition method includes the following steps:

[0070] Step S1100, acquiring hand images of the user collected by each of the binocular cameras.

[0071] Specifically, the binocular camera simulates the structural design of the human eye and is used to capture two left and right images of the user's hand in the same scene. Based on the obtained left and right images, the stereo matching algorithm can be used to obtain the third-dimensional depth information of the pixels of the two-dimensional image, and then based on the obtained two images, the user's hand posture data can be constructed from two dimensions: two-dimensional and three-dimensional , to improve the accuracy of user hand gesture recognition.

[0072] In one embodiment of the present disclosure, th...

Embodiment 2

[0161] image 3 It is a schematic flowchart of a gesture control method for a virtual reality device according to an embodiment of the present disclosure.

[0162] according to image 3 As shown, the gesture control method includes the following steps:

[0163] Step S3100, acquire the gesture recognition result of the user, and the gesture recognition result is obtained based on any one gesture recognition method mentioned above.

[0164] Step S3200, perform gesture control on opening, closing and parameter adjustment of the virtual control of the virtual reality device according to the gesture recognition result.

[0165] Specifically, the virtual control of the virtual reality device plays a very important role when the user interacts with the virtual scene. For example, in some virtual content scenes, the display brightness of the scene can be freely adjusted through the virtual control; for example, in some virtual content scenes , you can freely adjust some volumes in ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a gesture recognition and control method and device and virtual reality device.The gesture recognition method comprises the steps of acquiring a hand image, collected by each camera in binocular cameras, of a user; recognizing a first group of hand skeleton points in the obtained hand image through a pre-constructed recognition model, and obtaining a hand skeleton point image in which the recognized first group of hand skeleton points are marked on a hand region of the hand image; according to the obtained hand skeleton point image, obtaining a two-dimensional position relationship and a three-dimensional position relationship between skeleton points in a second group of hand skeleton points as hand posture data of the user; and performing gesture recognition of the user according to the hand posture data.

Description

technical field [0001] The present invention relates to the technical field of virtual reality equipment, and more particularly, to a gesture recognition and control method, device and virtual reality equipment. Background technique [0002] A virtual reality headset device may be used to provide a virtual reality experience by presenting virtual images to a user. Such a device is usually implemented as a head mounted display device (HMD: Head Mount Display). Virtual images can take the form of one or more virtual shapes, objects or other visual phenomena presented in such a way that they appear to exist in the virtual world, various virtual content through virtual reality headset The display screen of the all-in-one device is presented to the user, and the shape, object or visual phenomenon that exists in reality is integrated into the virtual scene to achieve the perfect fusion of virtual and reality. [0003] Among them, virtual controls play an important role in the in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G06N3/08
CPCG06F3/017G06N3/08G06V40/28G06V40/113G06V20/20G06V10/774G06V20/64G06F3/011G06V20/46G06V10/761G06V40/10G06V10/44
Inventor 吴涛
Owner QINGDAO PICO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap