Chinese speech recognition method based on pinyin constraint joint learning

Abstract

The invention relates to a Chinese speech recognition method based on pinyin constraint joint learning, and belongs to the technical field of natural language processing. According to the method, firstly, pinyin texts corresponding to voices and texts are collected from a public Chinese corpus set, secondly, speech features are encoded through a shared encoder, then pinyin speech recognition is used as an auxiliary task, and then pinyin is used as a decoding constraint in the decoding process. Pinyin speech recognition and Chinese speech recognition are combined for learning based on a sharedencoder, inductive bias closer to speech is introduced, and the expression ability of the encoder for Chinese speech is enhanced. According to the Chinese speech recognition method based on pinyin constraint joint learning provided by the invention, the word error rate of Chinese recognition is reduced, and powerful support is provided for subsequent work such as pinyin fusion and pinyin error correction in the Chinese speech recognition process; and the problem that the end-to-end model is difficult to converge in Chinese character recognition is relieved.

Description

technical field [0001] The invention relates to a Chinese speech recognition method based on joint learning of pinyin constraints, belonging to the technical field of natural language processing Background technique [0002] In the field of automatic speech recognition, the current speech recognition model has achieved good results in phonograms such as English and French. However, Chinese is a typical ideographic script, and there is no direct correspondence between Chinese characters and phonetics. However, Pinyin, as a symbol for the pronunciation of Chinese characters, has an internal connection with Chinese characters. The cascade method of recognizing phonetic features as syllable (pinyin) units and converting pinyin to Chinese characters through a conversion model has error propagation. In order to avoid this problem, the Chinese character-pinyin recognition model uses pinyin to help the recognition of Chinese characters during training. , but the recognition effect ...

AI Technical Summary

Problems solved by technology

[0003] The invention provides a Chinese speech recognition method based on joint learning of pinyin constraints, which is used to introduce pinyin as a constraint on Chinese character decoding in Chinese speech recognition, which can promote the model to learn better phonetic features, and alleviate the current system's difficulty in recognizing Chinese characters convergence problem

Images