Fingertip detection method based on Kinect depth information

Abstract

The invention relates to a fingertip detection method based on Kinect depth information. A device Kinect is connected to a computer through a cable. The method is characterized by comprising the firststep of extracting a hand and acquiring a palm coordinate; the second step of performing fingertip positioning including image preprocessing and hand contour; performing joint bilateral filtering onan extracted hand area; utilizing a Douglas-Poke algorithm to approximate a specified point set, finding out a polygon fitted curve of the hand contour and drawing out a fitted curve of the hand; thethird step of utilizing a convexHull () function to search the steps, and analyzing and obtaining a convex hull point of the hand; the fourth step of obtaining the curvature at the convex hull point,and according to the difference between the curvature of the wrist and the curvature of the fingertip, setting an appropriate threshold value to remove the convex hull point at the wrist. The method can complete gesture recognition tasks in real time and accurately, improve the real-time property and accuracy of Kinect gesture recognition, and improve natural gesture interaction experience.

Description

technical field [0001] The invention relates to a fingertip detection method based on depth information, belonging to the technical field of human-computer interaction. Background technique [0002] With the development of human-computer interaction technology, natural interaction has become the development direction of human-computer interaction technology. In recent years, using human hands for natural and intuitive interaction without wearing auxiliary equipment has gradually become a research hotspot in this field. [0003] The key to realizing natural human-hand interaction lies in the accurate recognition of gestures. At present, gesture recognition methods without wearing assistive devices mainly include methods based on color cameras and methods based on depth sensors. Gesture recognition based on color cameras is easily affected by complex lighting and background conditions, especially when the background is very complex, the recognition accuracy is extremely low....

AI Technical Summary

Problems solved by technology

Many scholars have begun to use Kinect for gesture recognition. However, most of the existing methods have cumbersome steps, complex algorithms, and poor real-time performance.

Images