Multi-posture fingertip tracking method for natural man-machine interaction

Abstract

The present invention discloses a multi-posture fingertip tracking method for natural man-machine interaction. The method comprises the following steps: S1: acquiring RGBD data by adopting Kinect2, including depth information and color information; S2: detecting a hand region: by means of conversion of a color space, converting a color into a space that does not obviously react to brightness so as to detect a complexion region, then detecting a human face by means of a human face detection algorithm, so as to exclude the human face region and obtain the hand region, and calculating a central point of a hand; S3: by means of the depth information and in combination with an HOG feature and an SVM classifier, identifying and detecting a specific gesture; and S4: by means of positions of preceding frames of fingertips and in combination with an identified region of the hand, performing prediction on a current tracking window, and then detecting and tracking a fingertip by means of two modes, i.e. a depth-based fingertip detection mode and a form-based fingertip detection mode. The method disclosed by the present invention is mainly used for performing detection and tracking on a single fingertip under motion and various postures, and relatively high precision and real-time property need to be ensured.

Description

technical field [0001] The invention relates to a multi-pose fingertip tracking method for natural human-computer interaction. Background technique [0002] Human-computer interaction (Human-Computer Interaction, HCI) is the study of communication and communication between humans and computers through mutual understanding. A technical science of assistants. 3D fingertip detection and tracking technology is an important branch of human-computer interaction technology. It realizes detection and tracking by describing the shape and characteristics of fingertips, and realizes the control of other devices and systems. The biggest advantage of this technology is that it can realize interaction through very natural fingertip movements, such as replacing electronic pens and controlling other external devices. On the basis of the current technology, there is a method of human-computer interaction and control by detecting and tracking the skeletal points of the hand joints, but this...

AI Technical Summary

Problems solved by technology

On the basis of the current technology, there is a method of human-computer interaction and control by detecting and tracking the skeletal points of the hand joints, but this large-scale hand movement has two important shortcomings. feel tired soon

The second is that this interaction method is not natural enough, and it cannot express well for some fine trajectories.

For mode switching, he uses the angle between the line connecting the palm and fingertips and the line connecting the arm point and the palm as the switching condition, which will limit the range of motion of the hand, and in many cases does not meet The assumptions of this conversion model

Images