Virtual input method based on sound waves

Abstract

The invention discloses a virtual input method based on sound waves. The method comprises the steps as follows: a frequency domain database is built after frequency domain feature vectors of the sound waves generated by knocking on different areas of the surface of an object are acquired at first; a knock rhythm is preset, and a time domain feature database is built; when a user knocks on the different areas of the surface of the object, the system acquires knock sound wave signals and extracts the frequency domain feature vectors, and matches the vectors with the frequency domain database to distinguish a knock position; meanwhile, when the user knocks on the surface of the object with different rhythms, the system acquires the knock sound wave signals and distinguishes action rhythms via complete time domain matching; the distinguished positions are combined with the rhythms to input different information into a terminal to achieve expanded input of the terminal; and at last, the terminal executes a response event according to the input information. The method provided by the invention combines time domain features with frequency domain features, is diverse in input information, increases input interestingness of the terminal, can be applied to the field of augmented reality and virtual reality, and enhances user experience.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a virtual input method based on sound waves. Background technique [0002] Terminal input, as the most direct way of human-computer interaction, is the most essential part of people's daily use. With the rapid development of the Internet age, terminal input methods have undergone tremendous changes. Although the traditional mouse and keyboard input are the fastest and most effective ways of office interaction, they are abandoned by many terminals such as tablet computers and mobile phones due to their shortcomings such as large space occupation and non-portability. It is replaced by portable and sensitive touch mobile and handwriting input, but it is easy to leave dirt, fingerprints, etc. on the screen directly to affect the display effect of the screen, and it is not sensitive or even invalid when it is wet, which brings bad effects to people. experience effe...

AI Technical Summary

Problems solved by technology

Although the traditional mouse and keyboard input are the fastest and most effective ways of office interaction, they are abandoned by many terminals such as tablet computers and mobile phones because of their shortcomings such as large space occupation and non-portability.

It is replaced by portable and sensitive touch mobile and handwriting input, but it is easy to leave dirt, fingerprints, etc. on the screen directly to affect the display effect of the screen, and it is not sensitive or even invalid when it is wet, which brings bad effects to people. experience effect

As a result, new technologies that do not directly contact the terminal, such as voice interaction and visual tracking and recognition, have emerged rapidly in recent years. Voice interaction involves speech recognition and semantic interaction processing, and visual tracking and recognition interaction involves image processing and image understanding. Direct processing on the terminal will consume a lot of computing resources on the terminal, and if it is indirectly processed on the network server, it will occupy a huge network bandwidth resource, making these new technologies a weak point criticized by users

It can be seen that the prior art has its own limitations and still needs to be improved.

Images