A query method based on lucene typos

Abstract

The invention relates to a query method based on Lucene typos, which divides the sentences of the text to be queried, selects the first word to see if it is a single-character word, and if it is a single-character word, queries the sound-like table and shape-like table, according to the sound The similar table and the similar table return the query result simset, and then perform a Cartesian product of the query result simset with the next word or the next word query result simset to obtain the Cartesian product result, and use the result to match all the words in the dictionary, if If the matching is successful, the error correction result will be returned and added to the error correction result set. If the error correction result set is empty, a null value will be returned and the match will be exited. If the error correction result set is not empty, all error correction results will be returned. Use error correction Result query; the first word in the query text sentence is not a single word, or result matches all words in the dictionary, if the match is unsuccessful, read the characters backward and repeat the previous steps. The invention has the advantages that: the invention makes the Lucene search more accurate and humanized, and improves the accuracy of the search.

Description

technical field [0001] The invention belongs to natural language processing in the field of artificial intelligence computers, in particular to a query method based on Lucene typos. Background technique [0002] With the rapid development of information processing technology and the Internet, traditional text work is almost completely replaced by computers, text electronic publications such as e-books, e-newspapers, emails, and office documents are constantly emerging, and there are more and more errors in texts . [0003] At present, most of them use manual proofreading. The proofreading work is monotonous, labor-intensive, and inefficient. Manual proofreading can no longer meet the needs of text proofreading. Therefore, the study of automatic text proofreading has far-reaching significance for both theory and application. Automatic text proofreading is one of the main applications of natural language processing, and it is also a difficult problem in natural language under...

AI Technical Summary

Problems solved by technology

[0006] 3) True word errors will interfere with the grammar and semantics of the entire sentence, so finding true word errors requires a lot of knowledge and resources;

[0007] 4) Data sparseness is a major obstacle for automatic proofreading of true word errors

The automatic proofreading method for Chinese true word errors of the present invention solves the problems of data sparseness, misjudgment of correct words, and low proofreading efficiency in the prior art, and has high effectiveness and accuracy; but the inventive method still has certain defects: In practical applications, this method requires a large amount of corpus training, and the retrieval takes a lot of time, which is not very good for the actual user experience

Images