Method and device of gesture tracking calculation based on three-dimensional model

A technology of three-dimensional model and calculation method, applied in the field of image processing, can solve the problems of rising misrecognition rate, gestures cannot move too fast, etc.

Inactive Publication Date: 2013-05-22
TSINGHUA UNIV
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It is easy to fall into local extremum, and it is impossible to get very accurate results as a whole;
[0005] (3) With the increase of gestures, the misrecognition rate will also increase significantly, and the gestures cannot move too fast

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device of gesture tracking calculation based on three-dimensional model
  • Method and device of gesture tracking calculation based on three-dimensional model
  • Method and device of gesture tracking calculation based on three-dimensional model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0037] In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, struc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method of gesture tracking calculation based on a three-dimensional model. The method includes: building a three-dimensional data model of a hand; inputting an image sequence, wherein a first frame image of the image sequence is lack of self occlusion and exterior occlusion, and divided according to preset color value; calculating an affine transformation matrix according to corresponding relations among outline pixel points and three-dimensional vertexes of images; obtaining class information of the three-dimensional vertexes according to the affine transformation matrix and obtaining a result after affine transformation according to the class information of the three-dimensional vertexes so as to obtain a three-dimensional hand model; and setting skeleton nodes and finger freedom degrees of the three-dimensional hand model, adding corresponding particle confinement for each skeleton nod, and obtaining a gesture outline matching picture through a particle filtering algorithm. According to the method of the gesture tracking calculation based on the three-dimensional model, a global optimization algorithm is adopted, an accurate three-dimensional initial model is needless, and tracking effects for inputted multi-view and low-resolution image or video sequences are good. The invention further discloses a device of the gesture tracking calculation based on the three-dimensional model.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a three-dimensional model-based gesture tracking calculation method and device. Background technique [0002] Gesture recognition and tracking technology has always been an important subject of human-computer interaction. The main purpose of researching gesture recognition and tracking technology is to introduce gestures, a natural and intuitive way of communication, into the human-machine interface to achieve an interface that is more in line with human behavior habits, thereby Get the required interaction information. In recent years, with the development of science and technology, gesture recognition and tracking technology has achieved a lot of research results. Traditional gesture recognition and tracking technologies can be divided into two categories: 1) use the skin color of the hand to perform template matching and other processing methods in the two-dimensiona...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/20G06K9/00
Inventor 戴琼海王雁刚索津莉
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products