Natural interactive method based on three-dimensional gestures

A technology of three-dimensional gestures and interaction methods, which is applied in the fields of user/computer interaction input/output, image data processing, instruments, etc., which can solve the problems of increasing the difficulty of user interaction, aggravating the integration of interactive tasks, unnaturalness, etc., and meeting real-time The effect of human-computer interaction

Active Publication Date: 2010-08-18
ZHEJIANG UNIV
View PDF2 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the one hand, this method is very unnatural, and increases the difficulty

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural interactive method based on three-dimensional gestures
  • Natural interactive method based on three-dimensional gestures
  • Natural interactive method based on three-dimensional gestures

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The natural interaction method based on three-dimensional gestures of the present invention interacts with virtual objects naturally through three-dimensional gestures in a virtual reality or augmented reality environment. Including the following steps:

[0018] 1. Input video images from two cameras, and use the online training skin color detection algorithm to obtain the foreground image of the hand. The online detection training skin color detection algorithm uses the clustering characteristics of human skin color in the YCbCr color space to segment the foreground figure of the hand by determining the specific color range in the video image. In the process of skin color detection, an online training method that learns the current skin color in real time is used to reduce the impact of illumination changes on skin color detection.

[0019] 2. Using the fingertip detection method to detect the position of the fingertip on the obtained hand foreground image. The finge...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a natural interactive method based on three-dimensional gestures, the method utilizes a computer vision technology to obtain local features of a hand by foreground segmentation and fingertip detection, and the local features include fingertip position, palm contour, palm center position and the like. By adopting the stereoscopic vision technology, the hand features such as the fingertip position, the palm center position and the like are reconstructed in the three-dimensional space. The finger tip position, the palm center position and the like in the three-dimensional space are parameterized, and a three-dimensional interactive model based on points, lines and planes is defined, thus realizing various three-dimensional gestures in the three-dimensional space, such as fingertip clicking, fingertip squeezing, palm overturning, fingertip directing and the like. The method needs only two ordinary network cameras to meet the demands of real-time man-machine interaction.

Description

technical field [0001] The invention relates to computer vision and human-computer interaction technology, in particular to a three-dimensional gesture-based human-computer interaction method. Background technique [0002] The traditional two-dimensional human-computer interaction technology (based on mouse / keyboard / joystick / window interface) has been relatively mature and perfect in terms of its software tools and interaction methods. However, with the continuous upgrading of human-computer interaction application requirements, including the increasing pursuit of virtual scene experience by users (called players in games), the limitations of traditional two-dimensional human-computer interaction methods are becoming more and more obvious. exist: [0003] From the perspective of information representation ability, complex multi-dimensional relationships cannot be represented in a natural way. When representing multi-dimensional relationships, it is necessary to use a multi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G06T17/00
Inventor 潘志庚郭康德邵兴旦李扬李光霞
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap