Method of Tracking Morphing Gesture Based on Video Stream

A video stream and optical flow tracking technology, applied in image data processing, instruments, computing, etc., can solve the problems of unsatisfactory nature, comfort, harmony, user discomfort, etc., and achieve accurate and reliable updates, robust gesture tracking, The effect of eliminating the interference of background changes and large areas of skin color

Inactive Publication Date: 2011-12-07
INST OF AUTOMATION CHINESE ACAD OF SCI +1
View PDF2 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First of all, how to deal with changing environments, such as light, background, viewing angle, etc., is also a common problem in the field of computer vision; secondly, how to deal with various deformations of the human hand, which is one of the most flexible organs and has a high degree of freedom Whether the h

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method of Tracking Morphing Gesture Based on Video Stream
  • Method of Tracking Morphing Gesture Based on Video Stream
  • Method of Tracking Morphing Gesture Based on Video Stream

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0019] figure 1 A flow chart of a method for tracking deformation gestures based on video streams according to an embodiment of the present invention is shown, and the specific steps are as follows:

[0020] Step 1: Acquire a frame image, and extract a sub-image containing a human hand from the acquired frame image. The monocular camera is used to obtain the frame image, and the detection algorithm is used to extract the sub-image containing the human hand from the acquired frame image. This step is to select a tracking target. In this embodiment, an automatic selection method is used to use human hands as the tracking target.

[0021] Step 2: Select feature tracking points from the sub-image containing the human hand, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for tracking deformable hand gesture based on video streaming, comprising the steps of: obtaining a frame image, and extracting a sub-image containing a human hand from the obtained frame image; selecting feature tracking points from the sub-image containing the human hand, and initializing a continuously self-adaptive mean shift tracker by the sub-image containing the human hand; performing optical flow calculation on the selected feature tracking points to serve as a local tracking result, and synchronously overall tracking the human hand by the continuouslyself-adaptive mean shift tracker to obtain a global tracking result; updating the feature tracking points; and adopting the result of the optical flow tracking as the final output result of the deformable hand gesture. The method for tracking the deformable hand gesture based on video streaming can be used for tracking the human hand with randomly deformable hand gesture and enabling human-computer gesture interaction to operate in a more comfortable manner. According to the invention, the tracking can be performed aiming at the randomly deformable hand gesture, the interference from change of a background and a large area of complexion is eliminated, and the real-time robust hand gesture tracking is achieved.

Description

technical field [0001] The invention relates to technical fields such as image processing, pattern recognition, and human-computer interaction, and in particular to a method for tracking deformation gestures based on video streams. Background technique [0002] The human-computer gesture interaction based on computer vision, its core is to use computer vision, image processing, pattern recognition and other technologies to detect, track and recognize the frame images in the video sequence collected by the camera, get various gestures of people, and Comprehend and respond to the behavior indicated by the gesture. In recent years, with the continuous development of computer vision and pattern recognition technology, gesture interaction technology has been applied to TV remote control, video games, video conferencing and other fields, bringing great convenience to people's life and entertainment. [0003] Gesture interaction based on computer vision is a key technology in the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/20
Inventor 王阳生石磊
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap