A gesture interaction system based on double finger angle domain characteristics and a working method thereof

An interactive system and working method technology, applied in the input/output of user/computer interaction, input/output process of data processing, instruments, etc., can solve the problems of reducing the experience of gesture recognition rate, missing finger position and direction information, etc.

Active Publication Date: 2019-04-09
SHANDONG UNIV
View PDF7 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, there are many researches on gesture recognition methods in gesture interaction systems at home and abroad, but most of the gesture recognition methods are based on hand contour and edge features or hand single-finger features for extraction and classification. The disadvantages of such gesture features It is unable to fully express the rich gestures of people, and it is easy to cause the omission of a certain type of finger position and direction information, thereby reducing the recognition rate of gestures and the user's experience when completing virtual interaction.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A gesture interaction system based on double finger angle domain characteristics and a working method thereof
  • A gesture interaction system based on double finger angle domain characteristics and a working method thereof
  • A gesture interaction system based on double finger angle domain characteristics and a working method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0075] A gesture interaction system based on two-finger angle domain features, such as figure 1 As shown, it includes a data acquisition module, a feature extraction module, a gesture recognition module and a virtual interaction module connected end to end in sequence;

[0076] The data acquisition module is connected to the feature extraction module, and the data acquisition module is directed to the feature extraction module. The feature extraction module is connected to the gesture recognition module, and the feature extraction module is directed to the gesture recognition module. The virtual interaction module, the virtual interaction module feeds back to the data acquisition module by obtaining the next frame, forming a closed loop.

[0077] The data acquisition module is used to: initialize the Leap motion, obtain the three-dimensional coordinate information of the gesture joint points within the effective field of view of the Leap motion, use the Leap motion binocular c...

Embodiment 2

[0082] A kind of working method of the gesture interaction system based on the two-finger angle domain feature described in Embodiment 1, such as figure 2 shown, including the following steps:

[0083] S01: Leap motion initialization; initialization refers to the process of connecting the Leap motion device to the host computer through the Leap motion SDK, and using the Leap Manager function to initialize the development environment configuration of the Leap motion device; after the Leap motion initialization is completed, enter step S02.

[0084] S02: Determine whether the user's gesture is within the Leap motion's line-of-sight range. The effective line-of-sight refers to: the field of view range of the Leapmotion sensor is 100-160°, and the effective detection distance is 25-600mm; if the user's gesture is not within the Leap motion within the line-of-sight range, enter step S03, otherwise, enter step S03';

[0085] Here, the obtained coordinate values ​​are all three-dim...

Embodiment 3

[0127] According to the working method of the gesture interaction system based on the two-finger angle domain feature described in Embodiment 2, the difference is that the field of view of the Leap motion sensor ranges from 150°.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a gesture interaction system based on double finger angle domain characteristics and a working method thereof. The gesture interaction system comprises a data acquisition module, a characteristic extraction module, a gesture recognition module and a virtual interaction module. The data acquisition module is used for initializing Leap motion and acquiring gesture information by using the Leap motion; The feature extraction module is used for three-dimensional coordinate preprocessing and gesture feature extraction; The gesture recognition module is used for inputting the extracted double-finger angle domain features into an SVM-KNN classification algorithm to perform gesture classification; And the virtual interaction module is used for connecting Leap motion with Unity 3D to realize different interaction control of different classified gestures on instruments in a gymnasium scene. According to the invention, the user experience is improved, and the user immersion is enhanced.

Description

technical field [0001] The invention relates to a gesture interaction system based on two-finger angle domain characteristics and a working method thereof, belonging to the technical field of intelligent perception and human-computer interaction. Background technique [0002] As one of the most frequently used communication methods for human beings, gestures can complete the process of human-computer interaction, which is called gesture interaction. Gesture interaction technology involves pattern recognition, image processing, virtual reality, human-computer interaction and other disciplines. At present, gesture interaction technology has broad application prospects and practical value in medicine, education, painting, somatosensory games, etc. For example, in the field of education, the virtual human anatomy teaching system developed using the 3D interactive software Unity3D combined with Kinect gesture recognition technology increases the realism and fun of teaching. In t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00G06K9/62
CPCG06F3/017G06V40/28G06F18/2411
Inventor 许宏吉李菲菲刘琚李玉军陈敏杜保臻李梦荷张贝贝
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap