Gesture tracking and accurate fingertip positioning system based on Kinect

A positioning system and precise technology, applied in the input/output process of data processing, input/output of user/computer interaction, instruments, etc., can solve problems such as difficulties in real-time hand tracking, eliminate shaking, improve accuracy, Improving the effect of real-time performance

Inactive Publication Date: 2020-02-14
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Correspondingly, the human-computer interaction technology based on hand movement is also indispensable in the stage of natural user interface interaction and has broad application prospects. However, since each hand has 27 degrees of freedom (DoF) and can rotate freely in space, it is difficult to achieve High-precision real-time hand tracking remains difficult

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture tracking and accurate fingertip positioning system based on Kinect
  • Gesture tracking and accurate fingertip positioning system based on Kinect
  • Gesture tracking and accurate fingertip positioning system based on Kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The specific embodiments of the present invention will be described in detail below, but it should be understood that the protection scope of the present invention is not limited by the specific embodiments.

[0030] Such as figure 1 As shown, the steps of the entire system are as follows:

[0031] Step 1: Original data optimization;

[0032] Step 1-1: Restoration of occlusion; when the hand is occluded or partially occluded, the real-time data fed back by the depth sensor will jitter severely, and the data is not highly reliable. At this time, it is necessary to predict the joint positions that are not tracked by the depth sensor. In this paper, the depth data is combined with the bone data provided by Kinect to repair the occluded hand joint points. Since the human bones have length invariance, the elbows, hands, wrists, and fingertips constitute a joint chain. The length between each adjacent joint is calculated and the length of the joint is compared with the standard hum...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a gesture tracking and accurate fingertip positioning method based on Kinect. According to the method, the tracking quality of hand disordered motion and the accuracy of fingertip positioning are improved. Taking Kinect as an example, the method comprises: reading depth information from Kinect, and completing shielding repair of hand skeleton information through assistanceof skeleton data and forward kinematics; after the optimized bone joint point information is obtained, conducting smooth processing on the tracked palm motion information through a Kalman filtering algorithm; then, extracting a hand region from the depth image by using the real-time palm coordinate information and adopting a connected region analysis algorithm of firstly performing coarse extraction and then performing fine extraction; and finally, obtaining a convex hull of the hand contour, filtering out fingertip approximate points by adopting a method of analyzing a geometrical relationship between the convex hull and a palm center point, and calculating a curvature value to obtain accurate fingertip points. Therefore, real-time tracking of the hand is realized, and the accuracy of fingertip positioning is improved according to experimental result analysis.

Description

Technical field [0001] The present invention is a Kinect-based gesture tracking and precise fingertip positioning system, which belongs to the field of human-computer interaction based on hand movement information. Background technique [0002] With the continuous advancement of computer technology and sensor performance, Human-ComputerInteraction technology has developed to the stage of natural user interface (Natural User Interface) with human as the core, requiring machines to communicate with users as naturally as humans. ,interactive. In daily life, the most commonly used means of communication by humans is the combination of sight, listening, and speaking, and hands play a vital role in daily interaction. Correspondingly, human-computer interaction technology based on hand movement is also indispensable in the natural user interface interaction stage and has a wide application prospect. However, since each hand has 27 degrees of freedom (DoF) and can rotate freely in space...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
CPCG06F3/014G06F3/017
Inventor 吕倩葛文潇魏昕陈建新
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap