Speech recognition method and device based on Chinese and English mixed dictionary

Abstract

The invention provides a speech recognition method and a speech recognition device based on a Chinese and English mixed dictionary. The speech recognition method comprises the steps of: acquiring the Chinese and English mixed dictionary marked by the International Phonetic Alphabet IPA, wherein the Chinese and English mixed dictionary comprises a Chinese dictionary and an English dictionary corrected by means of the Chinese dictionary; training the model by regarding the Chinese and English mixed dictionary as a training dictionary, regarding a layer of convolutional neural network CNN plus five layers of Long Short-Term Memory (LSTM) network as a model, regarding status of the IPA as a target and regarding a connectionist time classifier CTC as a training criterion, so as to obtain a trained CTC acoustic model; and combining with the trained CTC acoustic model for performing speech recognition on a Chinese and English mixed language. According to the speech recognition method and the speech recognition device, the Chinese and English mixed dictionary comprising the Chinese dictionary and the English dictionary corrected by means of the Chinese dictionary is adopted for training, the English word coverage is comprehensive and Chinglish can be recognized, and the accuracy degree of Chinese and English mixed language recognition is further improved by combining the application of the CTC acoustic model.

Description

technical field [0001] The invention relates to the technical field of voice recognition, in particular to a voice recognition method and device based on a Chinese-English mixed dictionary. Background technique [0002] Currently, with the globalization of life, the phenomenon of using mixed languages ​​to communicate has become a common phenomenon. Statistically, there are more people who speak multiple languages ​​than monolingual speakers. Acoustics between mixed languages ​​and complexities between languages ​​pose challenges for speech recognition. Therefore, the study of mixed language acoustic models is an important research direction. [0003] Hybrid speech recognition technology refers to the use of Chinese and English mixed dictionaries to train the mixed language acoustic model to obtain a speech recognition model. At present, the method of obtaining a Chinese-English mixed dictionary is to obtain a Chinese dictionary including a phoneme set marked with consona...

AI Technical Summary

Problems solved by technology

[0005] For this reason, the first object of the present invention is to propose a kind of speech recognition method based on Chinese-English mixed dictionary, for solving the low problem of speech recognition accuracy in the prior art

Images