KINECT-based multi-finger real-time tracking method

A real-time tracking and multi-finger technology, applied in the input/output process of data processing, input/output of user/computer interaction, image data processing, etc., can solve problems such as robustness, and achieve fast response speed and system stability High effect with high user experience

Inactive Publication Date: 2017-10-17
HOHAI UNIV CHANGZHOU
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Some researchers tried to use KINECT for multi-finger tracking research, but they all designed a more robust two-dimensional fingertip detection algorithm based on the depth map given by KINE

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • KINECT-based multi-finger real-time tracking method
  • KINECT-based multi-finger real-time tracking method
  • KINECT-based multi-finger real-time tracking method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The present invention will be further described below in conjunction with the accompanying drawings.

[0055] Such as figure 1 Shown, a kind of multi-finger real-time tracking method based on KINECT comprises the following steps:

[0056] Step 1: Obtain the depth image of the person with KINECT;

[0057] Step 2: Segment the hand area;

[0058] Step 3: Detect the two-dimensional fingertip position;

[0059] Step 4: Obtain the three-dimensional fingertip position;

[0060] Step 5: Track the three-dimensional fingertip position to obtain its motion trajectory.

[0061] Such as figure 2 As shown, after KINECT acquires the depth image, the hand area is segmented in a boxed manner. The hand region segmentation includes the following steps:

[0062] 2a: Use the NITE library to track the center point position of the hand, and then extract the depth hand area according to the depth coordinates of the center point:

[0063]

[0064] Among them, Z hand Represents the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a KINECT-based multi-finger real-time tracking method. The method comprises the following steps of: 1, carrying out hand area segmentation; 2, carrying out fingertip detection on the basis of pixel classification; 3, obtaining a three-dimensional position of a fingertip; and 4, tracking a three-dimensional fingertip trajectory. The KINECT-based multi-finger real-time tracking method is capable of rapidly and correctly carrying out finger tracking in real time, and is high in system stability, high in user experience degree and high in reaction speed.

Description

technical field [0001] The invention relates to a KINECT-based multi-finger real-time tracking method and belongs to the technical field of biometric computer identification. Background technique [0002] In virtual reality and human-computer interaction systems, real-time, accurate and stable multi-finger tracking can bring users a friendly interactive experience. Based on its rich application prospects, 3D multi-finger tracking has attracted extensive attention from researchers. Its algorithm is mainly divided into four steps: segmentation of hand area, detection of fingertips, acquisition of 3D position and its trajectory tracking. Among them, the segmentation of the hand area is a very important step, because it directly determines the accuracy of the fingertip detection algorithm. However, the disadvantage of this method is that it is easily affected by the external environment such as lighting, and it is easy to fail in the case of poor lighting conditions. For this...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G06K9/62G06T7/277
CPCG06F3/017G06T7/277G06T2207/10016G06T2207/30196G06V40/28G06F18/24323
Inventor 卢光宏童晶尹薇娜顾晨婷
Owner HOHAI UNIV CHANGZHOU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products