Fingertip detection method based on Kinect depth information

A technology of fingertip detection and depth information, which is applied in the field of human-computer interaction, can solve problems such as cumbersome steps, complex algorithms, and poor real-time performance, and achieve the effect of accurate acquisition

Active Publication Date: 2018-04-06
CHANGCHUN UNIV OF SCI & TECH
View PDF7 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Many scholars have begun to use Kinect for gesture recognition. However, most of the existing methods have cumbersome steps, complex algorithms, and poor real-time performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fingertip detection method based on Kinect depth information
  • Fingertip detection method based on Kinect depth information
  • Fingertip detection method based on Kinect depth information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The implementation of the present invention will be described in detail below in conjunction with the drawings and specific examples.

[0029] Step S11, Kinect is placed on the desktop, the palm is perpendicular to the desktop, the palm faces the Kinect, and the distance from the Kinect is about one meter, such as figure 1 shown. Push the palm forward and then retract it to trigger the gesture tracking function of the NITE function library.

[0030] Step S12, use the NITE function library to obtain the coordinates of the palm, and then calculate the approximate depth range of the hand through the depth of the palm point.

[0031] Step S13, use the depth range obtained in S12 to set the search area and the depth threshold, use the depth binary mask to pass through an n*n matrix, and multiply the elements in n rows and n columns with the palm area to separate the hand image from the background .

[0032] Step S21 , first collect the depth image and the color image of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a fingertip detection method based on Kinect depth information. A device Kinect is connected to a computer through a cable. The method is characterized by comprising the firststep of extracting a hand and acquiring a palm coordinate; the second step of performing fingertip positioning including image preprocessing and hand contour; performing joint bilateral filtering onan extracted hand area; utilizing a Douglas-Poke algorithm to approximate a specified point set, finding out a polygon fitted curve of the hand contour and drawing out a fitted curve of the hand; thethird step of utilizing a convexHull () function to search the steps, and analyzing and obtaining a convex hull point of the hand; the fourth step of obtaining the curvature at the convex hull point,and according to the difference between the curvature of the wrist and the curvature of the fingertip, setting an appropriate threshold value to remove the convex hull point at the wrist. The method can complete gesture recognition tasks in real time and accurately, improve the real-time property and accuracy of Kinect gesture recognition, and improve natural gesture interaction experience.

Description

technical field [0001] The invention relates to a fingertip detection method based on depth information, belonging to the technical field of human-computer interaction. Background technique [0002] With the development of human-computer interaction technology, natural interaction has become the development direction of human-computer interaction technology. In recent years, using human hands for natural and intuitive interaction without wearing auxiliary equipment has gradually become a research hotspot in this field. [0003] The key to realizing natural human-hand interaction lies in the accurate recognition of gestures. At present, gesture recognition methods without wearing assistive devices mainly include methods based on color cameras and methods based on depth sensors. Gesture recognition based on color cameras is easily affected by complex lighting and background conditions, especially when the background is very complex, the recognition accuracy is extremely low....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/017G06F2203/012G06V40/107
Inventor 权巍张超韩成薛耀红李华胡汉平陈纯毅蒋振刚杨华民冯欣王蒙蒙
Owner CHANGCHUN UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap