A Chinese text automatic error correction method and device

Abstract

The present invention provides a method and device for automatic error correction of Chinese text, the method comprising: performing shallow error correction on the text to be corrected to obtain the first sentence sequence; performing deep neural network model correction on the first sentence sequence to obtain the fifth sentence Sequence; post-processing the fifth sentence sequence to obtain a corrected sample; output the corrected sample and error information. The device of the present invention includes: a shallow layer error correction module, a deep neural network model correction module, a post-processing module, and an integrated output module, wherein the deep neural network model correction module consists of an equal-length sequence error correction unit, word redundancy error correction It is composed of unit, word missing error correction unit, language model judgment unit and three-model fusion unit, and the post-processing module is composed of place name error detection unit and sensitive word error detection unit. The invention can realize the automatic generation of data sets and the correction of deep neural network models, the Chinese error correction range is more comprehensive, and the error correction efficiency is higher.

Description

technical field [0001] The invention relates to the technical field of natural language processing, and in particular, to a method and device for automatic error correction of Chinese text. Background technique [0002] Internet data dissemination is an important feature of the current big data era. In the process of Internet data dissemination, there are a large number of electronic documents. The content quality of electronic documents will not only affect the reading experience of readers, but also affect the public influence of the author. Among them, the correct expression of Chinese is a key factor to improve the quality of the content of the article. How to identify Chinese errors in electronic document data has become a time-consuming and labor-intensive task that must be done. On the one hand, due to the richness and variety of Chinese expressions, there are many kinds of errors. On the other hand, with the development of artificial intelligence technology, speech r...

AI Technical Summary

Problems solved by technology

This method has the following disadvantages: 1) The construction of the confused word set requires a large amount of wrong data in real scenarios; 2) It also requires a lot of manual experience; 3) The confused word set depends on different data fields, and it is difficult to exhaust all errors Possibilities, so the ability to generalize to new scene data is very limited

[0005] The second idea is to apply the deep neural network model to Chinese error correction tasks and try Chinese error correction methods in different scenarios. The disadvantage is that the error correction scene is single, and there is still a large room for improvement in error correction accuracy.

Images