A skin-based finger gesture recognition method based on smart watch

Abstract

The present invention disclosed a method of recognition method based on smart watches, including: step 1, signal collection: passive acoustic signals generated by friction between fingers and back skin of the back of the hand through smart watches; step 2, data pre -processing: passed through: passedFiltering processing removal of noise signals, obtaining acoustic signals to be tested; step 3, gesture action detection: through gesture detection processing to divide the acoustic signal to be detected into multiple independent gesture acoustic signals; step 4, feature extraction: multiple independent gesture acoustic signalsConverted to grayscale images to represent the image signal and the image of the spectrum diagram and the Merr's head genealogy coefficient as a feature value; step 5, gesture movement recognition: the extraordinary value of each independent finger movement is used as the input data, using the convolutional nerve nerve nerveThe network model recognizes the finger gesture movement of the input data to obtain the corresponding finger gesture movement.This method expands the input area of wearable devices without being equipped with other equipment, which has the advantages of simple and real -time.

Description

technical field [0001] The invention relates to the application field based on smart watches, in particular to a skin-based finger gesture recognition method based on smart watches. Background technique [0002] At present, a lot of research has developed many new software based on smart watches and proposed many new methods for smart watch interaction. Many previous studies have used some special hardware or sensors. For example, Google has developed a special chip in the project Soli, which uses 60GHz radar to replace normal input with hand movements; WatchIt provides a device prototype for expanding smart bracelet input; Motion sensors to infer what the user is writing. [0003] Human skin can be used as an input surface that can be used at any time, and there are also many technologies that have studied this aspect. For example, a new type of skin-worn hardware is designed in the existing disclosed technical solutions. Or use some unusual technology, such as electrica...

AI Technical Summary

Problems solved by technology

[0004] However, in the above-mentioned existing methods using human skin input, there are problems such as requiring specific hardware or complex system configuration.

Images