An interactive method and interactive system based on fingerprint and gesture recognition

Abstract

The present invention provides an interaction method and an interaction system based on fingerprint and gesture recognition. The interaction method based on fingerprint and gesture recognition includes the following steps: step S1, detecting the contact between the finger and the interactive device; step S2, according to the contact Detect and query the preset fingerprint information database, and judge whether the finger fingerprint in contact matches the fingerprint in the fingerprint information database, if so, jump to step S3, otherwise return to step S1; step S3, identify the gap between the finger fingerprint and gesture recognition The action command corresponding to the combination; step S4, output the command information corresponding to the action command; wherein, the interactive device includes a fingerprint recognition module and a flexible touch screen module for recognizing gestures. The present invention can achieve the technical effect of "blind typing" through the action command corresponding to the combination of finger print and gesture recognition, and is easy to use, has high degree of humanized design and personalized design, and is safe and reliable.

Description

technical field [0001] The invention relates to a human-computer interaction method, in particular to an interaction method based on fingerprint and gesture recognition, and to an interactive system adopting the interaction method based on fingerprint and gesture recognition. Background technique [0002] The current human-computer interaction of smart terminals is mostly based on the screen, which senses the pressure and movement of the user's finger through the capacitive screen, and triggers the corresponding command through the judgment of the click position and the sliding action. For example, the Android mobile phone system will provide three positions, and the actions such as return, menu and screen lock can be realized by clicking the user's finger. Tap and swipe on the screen to submit commands. [0003] That is to say, in the use of this traditional interactive behavior, the user must locate the terminal and the spatial position of the finger through the visual se...

AI Technical Summary

Problems solved by technology

[0003] That is to say, in the use of this traditional interactive behavior, the user must locate the terminal and the spatial position of the finger through the visual senses to ensure smooth and accurate interaction. With the continuous evolution of portable terminal forms, such as VR devices, AR devices and The application of wearable devices such as smart glasses is becoming more and more widespread. In their use, if the spatial positioning of hands or fingers is still required by the visual senses, and then through actions such as clicking and sliding on the actual or virtual screen, the user experience will be improved. It will be greatly discounted, unable to meet the needs of users, and the experience will be poor

Images