Natural language correction method, system, device and storage medium

Abstract

The present invention provides a natural language correction method, system, equipment and storage medium, the method includes inputting the text word vector sequence before correction as a model, outputting the text word vector sequence after correction as a model, and training the sequence-to-sequence model for correction ;Adopt the correct text used for training as the training set of the language model, and count the probability that all r characters jointly appear continuously, and r is the preset statistical fineness; Input the sequence-to-sequence model used for the correction from the vector sequence of the text to be corrected , outputting a plurality of candidate sentences; inputting the plurality of candidate sentences into the language model, calculating the occurrence probability of each candidate sentence respectively, and using the candidate sentence with the highest occurrence probability as an output corrected sentence. By adopting the solution of the present invention, the traditional natural language processing method is replaced to solve the problem of Chinese natural language correction, the maintenance cost is reduced, and the accuracy rate is greatly improved.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to a natural language correction method, system, equipment and storage medium. Background technique [0002] In the field of natural language processing, it is often necessary to process text information, because of different sources of text, there may be errors such as typos and grammatical errors. Natural language correction technology is widely used to correct text errors, correcting wrong sentences, phrases or words into correct and processable text information, among which the application of correcting wrong sentences is the most common. [0003] At present, the most extensive Chinese natural language correction system uses traditional natural language processing (NLP) technology to solve the problem of sentence correction from two aspects: 1. Pre-set the wrong word library containing all wrong words to match sentences The wrong words in the sentence, c...

AI Technical Summary

Problems solved by technology

[0004] However, due to the diversity of language expressions, the accuracy of matching wrong words through the wrong thesaurus is relatively low, and some grammatical and punctuation errors cannot be corrected

At the same time, this method requires a lot of manpower to collect and sort out the wrong lexicon. Therefore, in the actual application of enterprises, the natural language correction system based on traditional natural language processing cannot meet the needs of online applications in terms of accuracy and cost.

Images