Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Gesture recognition method, system and device based on augmented reality

A gesture recognition and augmented reality technology, applied in the field of information processing, can solve the problems of low gesture recognition rate and poor real-time gesture recognition.

Active Publication Date: 2019-07-09
UNIV OF JINAN
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present application provides a gesture recognition method, system and device based on augmented reality to solve the problems of poor real-time gesture recognition and low gesture recognition rate in the gesture recognition method of the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture recognition method, system and device based on augmented reality
  • Gesture recognition method, system and device based on augmented reality
  • Gesture recognition method, system and device based on augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0065] see figure 1 , figure 1 It is a schematic flowchart of an augmented reality-based gesture recognition method provided by the embodiment of the present application. Depend on figure 1 It can be seen that the gesture recognition method based on augmented reality in this embodiment mainly includes the following steps:

[0066] S1: Acquire a gesture depth map and gesture depth information of a human hand, where the gesture depth map includes static video frames and dynamic video frames, and the gesture depth information includes joint point coordinates.

[0067] In this embodiment, a kinect somatosensory device may be used to obtain gesture depth information and a gesture depth map of a human hand. Use the bone information of the kinect somatosensory device to obtain the joint point coordinates of the human hand, that is, the depth coordinates, and obtain the gesture depth map.

[0068] In this embodiment, the gesture depth map includes static video frames and dynamic v...

Embodiment 2

[0109] exist figure 1 On the basis of the illustrated embodiment see figure 2 , figure 2 It is a schematic structural diagram of an augmented reality-based gesture recognition system provided by the embodiment of the present application. Depend on figure 2 It can be seen that the gesture recognition system based on augmented reality in this embodiment mainly includes seven parts: an information acquisition module, a set classification module, a cutting module, an optimization module, a recognition model building module, a testing module and a recognition module.

[0110] Wherein, the information acquisition module is used to acquire the gesture depth map and gesture depth information of the human hand, the gesture depth map includes static video frames and dynamic video frames, and the gesture depth information includes joint point coordinates. The set classification module is used to divide the gesture depth map into a training set and a test set according to the ratio ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a gesture recognition method, system and device based on augmented reality. The method comprises the following steps of: acquiring a gesture depth map and gesture depth information of a human hand m dividing the gesture depth map into a training set and a test set, cutting the gesture depth map in the training set and the gesture depth map in the test set into n units withthe same size, optimizing dynamic video frames in the two sets through a DTW algorithm, establishing a dual-structure network recognition model then inputting the test set into the recognition modelto be tested, and a gesture recognition result is obtained; and in an augmented reality environment, identifying the gesture according to the gesture depth information and the identification model. The system comprises an information acquisition module, a set classification module, a shearing module, an optimization module, an identification model establishment module, a test module and an identification module. The device comprises a processor and a memory in communication connection with the processor. Through the application, the real-time performance of gesture recognition and the gesturerecognition rate can be effectively improved, so that the user experience is improved.

Description

technical field [0001] The present application relates to the technical field of information processing, in particular to a gesture recognition method, system and device based on augmented reality. Background technique [0002] Augmented reality is also called AR (Augmented Reality). With the development of human-computer interaction technology, augmented reality, as a technology to enhance the interactive ability between reality and virtual reality, has attracted more and more attention. Most of the current augmented reality technologies are based on wearable devices such as data gloves or use gesture recognition sensors to complete the fusion of real hands and virtual scenes. Therefore, how to perform gesture recognition in augmented reality technology is an important issue. [0003] At present, a gesture recognition method commonly used is a gesture recognition method based on geometric features. Specifically, this method is mainly aimed at the test objects in the train...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/113G06V40/28G06N3/045
Inventor 冯志全肖梦婷
Owner UNIV OF JINAN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com