Real-time three-dimensional gesture tracking method based on geometric method

A real-time three-dimensional, geometric method technology, applied in the field of human-computer interaction, to achieve the effect of improving algorithm efficiency, reducing search range and improving efficiency

Inactive Publication Date: 2019-09-20
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the development of human-computer interaction applications based on hand motion, it is required to accurately reflect the real motion of the hand in free space, thus posing new challenges to real-time processing algorithms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time three-dimensional gesture tracking method based on geometric method
  • Real-time three-dimensional gesture tracking method based on geometric method
  • Real-time three-dimensional gesture tracking method based on geometric method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Below in conjunction with accompanying drawing, the present invention is described in further detail.

[0043] Such as figure 1 As shown, the steps of the whole system are as follows:

[0044] Step 1: Raw data optimization:

[0045] The original depth information of the hand in the three-dimensional space obtained from the depth sensor has a lot of noise and holes. If it is not processed, the edge information of the extracted hand area will be distorted, so that the position of the fingertip is not accurate. Here, pixels are used The filter repairs and denoises it, smoothing the output.

[0046] Step 2: Extract the hand region:

[0047] Step 2-1: hand region ROI extraction, according to the fact that the hand is always in front of the body when moving, we select the box with the smallest depth as the hand region ROI.

[0048] Step 2-2: Hand region ROI tracking, such as figure 2 As shown, it can be seen that the located ROI position may exceed the hand area. Here we...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time three-dimensional gesture tracking method based on a geometric method. By using a geometric method, a hand position, a palm center and fingertips are captured in real time through a depth sensor to carry out gesture tracking. The depth information is repaired and denoised by using the pixel filter, so that the accuracy of determining the position of the subsequent fingertip is improved. Through an object recognition method, a square frame with the minimum depth is selected as the position of a hand region of interest, the hand region of interest is predicted and corrected through nuclear correlation filtering, an arm region is removed through principal component analysis, and the accuracy of the whole system is improved. The expanded inscribed circle is used for removing the part belonging to the inscribed circle internal region, so that the search range determined by the fingertip point is reduced, and the efficiency of the whole system is improved. The geodesic distance is only applied to the outer area of the inscribed circle, the position of a fingertip point is more accurately and stably determined, and the real-time performance of the system is improved. The finger areas are marked differently, so that the interference of the subsequent fingertips on the preorder fingertips is eliminated.

Description

technical field [0001] The invention belongs to the field of human-computer interaction based on hand motion information, in particular to a real-time three-dimensional gesture tracking method based on a geometric method. Background technique [0002] Human-computer interaction is the study of communication and communication between humans and computers that understand each other through input and output signals, and completes functions such as information management, service, and processing for people to the greatest extent. The emergence of natural user interaction interface makes people get rid of the dependence on traditional external devices in the interaction process, as well as the restrictions brought by traditional external devices to the interaction process, making the process of human-computer interaction smoother and more natural, and the application scenarios of human-computer interaction more convenient. Wide and varied. Since the hand plays an important role ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/32G06K9/62G06T5/00G06T7/50
CPCG06T7/50G06T5/002G06V40/28G06V10/25G06F18/213
Inventor 陈建新姚玲林清宇陈志敏成立明
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products