Finger tip detection and gesture identification method and system based on depth information

Abstract

The invention discloses a finger tip detection and gesture identification method based on depth information. The method comprises the following steps: obtaining a depth image comprising gesture information, performing coarse segmentation on a hand portion by use of a threshold method to obtain a hand shape with a part of a forearm area; realizing accurate segmentation of a hand area through detecting a wrist feature identification, and extracting a hand contour curve; obtaining a hand simplified broken line by simplifying the hand contour curve by use of a discrete curve evolution method; detecting finger tips on the hand simplified broken line by use of the threshold method; and identifying a gesture according to the quantity of the finger tips included in the hand simplified broken line and a set gesture model. The method can accurately segment the hand area, and at the same time, detects the finger tips and identifies the gesture. The invention further provides a corresponding finger tip detection and gesture identification system based on depth information.

Description

technical field [0001] The invention belongs to the technical field of image recognition, and more particularly relates to a method and system for fingertip detection and gesture recognition based on depth information. Background technique [0002] Fingertip detection and gesture recognition are an important means of human-computer interaction. In recent years, with the rise of mobile Internet technology, vision-based fingertip detection and gesture recognition technology has been widely used in home entertainment, smart driving, smart wear and other fields due to its advantages of non-contact and low cost. Applications. [0003] The key to fingertip detection and gesture recognition is to segment the collected gesture images to obtain the shape features of gestures. Traditional vision-based fingertip detection and gesture recognition systems use optical sensing devices to collect gesture information. However, due to the sensitive nature of the optical sensor, the image c...

AI Technical Summary

Problems solved by technology

[0007] Aiming at the above defects or improvement needs of the prior art, the present invention provides a method and system for fingertip detection and gesture recognition based on depth information. The contour curve of the hand is simplified into a broken line, the fingertips are detected on the simplified broken line of the hand, and the gesture is recognized according to the number of detected fingertips and the template matching method, thus solving the problem of the gesture area in the prior art Technical problems that cannot be accurately segmented, gesture curves contain a lot of deformation and noise that affect recognition accuracy, and fingertip detection and gesture recognition are difficult to perform simultaneously

Images