A silent voice acquisition and processing method and device based on ear cavity vibration

Abstract

The invention discloses a silent voice collection and processing method and equipment based on ear cavity vibration. The method is as follows: 1) The silent voice collection unit continuously monitors the vibration signal of the wearer's ear cavity. Simultaneously start signal collection, and send the collected signal to the data processing end; 2) After receiving the signal, the data processing end divides the collected continuous voice signal and vibration signal into several frames with the set time length as the basic unit , and calculate the average energy and average frequency of each frame, and then compare the calculation result with the set energy threshold to determine whether the user is traditional voice input or silent voice input; 3) For traditional voice input, call the end-to-end voice recognition model to perform Voice content recognition; for silent voice input, the convolutional neural network model is used to perform feature extraction, fusion and content recognition on the collected vibration signals.

Description

technical field [0001] The invention belongs to the field of human-computer interaction, and relates to a silent voice input suitable for a variety of different noise environments, in particular to a silent voice acquisition and processing method and device based on ear cavity vibration. Background technique [0002] Voice input has always been one of the key issues in the field of human-computer interaction. Traditional voice input has obvious shortcomings because of its high requirements on the environment, such as it is inconvenient to use normal volume of voice for text input due to privacy issues in public places and use traditional voice for input in noisy environments. When the text recognition effect is not good, etc. Therefore, the traditional voice input is only suitable for use in a relatively quiet (no noise) and private environment, which completely cannot meet the needs of users for voice input in various noise environments. At present, in order to avoid vari...

AI Technical Summary

Problems solved by technology

Traditional voice input has obvious disadvantages because of its high requirements on the environment. For example, it is inconvenient to use normal volume of voice for text input in public places due to privacy issues and use traditional voice for input in noisy environments. When the text recognition effect is not good, etc.

Therefore, the traditional voice input is only suitable for use in a relatively quiet (no noise) and private environment, which cannot meet the needs of users for voice input in a variety of different noise environments.

At present, in order to avoid collecting various environmental noises around the user's voice input, voice collection methods based on bone conduction have emerged. Although these methods do not collect environmental noise to a certain extent, because the source of the collected signal is still high-decibel traditional voice input, so the voice accuracy collected by these methods is greatly affected by the accuracy of the user's pronunciation

However, there is still no relevant technology and research on low-decibel silent speech acquisition and recognition based on the ear cavity.

Images