Unlock instant, AI-driven research and patent intelligence for your innovation.

Control gesture recognition method and system in augmented reality environment

A gesture recognition and augmented reality technology, applied in the field of human-computer interaction, can solve problems such as inability to guarantee real-time performance and robustness, and occupying large hardware resources

Active Publication Date: 2021-04-02
SHANGHAI JIAOTONG UNIV
View PDF14 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in order to realize complex gesture interaction, it often needs to occupy a lot of hardware resources, which cannot guarantee real-time and robustness

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Control gesture recognition method and system in augmented reality environment
  • Control gesture recognition method and system in augmented reality environment
  • Control gesture recognition method and system in augmented reality environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0078] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0079] In describing the present invention, it is to be understood that the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", The orientation or positional relationship indicated by "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying the referred device Or elements ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a control gesture recognition method in an augmented reality environment, which includes the following steps: data acquisition step: according to the depth data obtained by tracking and obtaining the human hand through the depth camera, and calculating the three-dimensional coordinates of the key points of the hand to obtain the key points of the hand motion feature sequence; neural network processing step: track and identify the motion feature sequence of the key points of the hand, and obtain the feature sequence of the gesture; gesture recognition step: obtain the gesture recognition result according to the feature sequence of the gesture. Correspondingly, the present invention also provides a control gesture recognition system in an augmented reality environment. The present invention can accurately and quickly identify gestures, reduces resource occupation, and improves robustness and real-time performance.

Description

technical field [0001] The present invention relates to the technical field of human-computer interaction; in particular, it relates to gesture control, somatosensory game operation, augmented reality, virtual reality, mixed reality, computer operation, sign language recognition, medical control field; in particular, it relates to an augmented reality environment A control gesture recognition method and system are disclosed. Background technique [0002] Human-computer interaction technology (Human-Computer Interaction Techniques) refers to the technology of realizing the dialogue between human and computer in an effective way through computer input and output devices. Its main research is the information exchange between human and computer, including two parts of information exchange from human to computer and from computer to human. The information exchange between people and computers mainly relies on interactive devices, such as early people operating and interacting wi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06K9/00G06T7/246G06T19/00G06N3/04
CPCG06F3/017G06T7/246G06T19/006G06T2200/04G06T2207/20084G06T2207/20081G06T2207/10028G06V40/28G06N3/044
Inventor 赵群飞董嘉棋颜庭满夏泽洋
Owner SHANGHAI JIAOTONG UNIV