Disambiguation method and systemin traditional Chinese medicine text word segmentation process, equipment and medium

Abstract

The invention discloses a disambiguation method in a traditional Chinese medicine text word segmentation process. The disambiguation method comprises the steps of obtaining a to-be-segmented traditional Chinese medicine text; preprocessing the traditional Chinese medicine text; performing word segmentation processing on the preprocessed traditional Chinese medicine text; matching a result after word segmentation processing with a pre-constructed combined ambiguous word bank, and screening out combined ambiguous words and non-combined ambiguous words from the result after word segmentation processing; storing the non-combined ambiguous words into a word segmentation result database; performing word frequency and part-of-speech tagging on the screened combined ambiguous words, calculating amutual information vector of the current combined ambiguous words according to the part-of-speech and the part-of-speech frequency of the screened combined ambiguous words, inputting the mutual information vector into a pre-trained support vector machine model, and outputting whether the category of the current combined ambiguous words is a detachable category or not; and realizing splitting or non-splitting processing of the current combined ambiguous word according to the category. Correct word segmentation of combined vocabularies in the traditional Chinese medicine text word segmentation process is eliminated, and accurate disambiguation of the combined traditional Chinese medicine vocabularies is achieved.

Description

technical field [0001] The present disclosure relates to the technical field of text word segmentation, and in particular to a disambiguation method, system, device and medium in the process of text word segmentation in traditional Chinese medicine. Background technique [0002] The statements in this section merely mention background art related to the present disclosure and do not necessarily constitute prior art. [0003] In the process of realizing the present disclosure, the inventors found that the following technical problems existed in the prior art: [0004] In the existing process of word segmentation of TCM texts, the result of word segmentation is not accurate enough, especially for words with compound ambiguity, accurate word segmentation and accurate disambiguation cannot be achieved, resulting in unsatisfactory word segmentation results. Contents of the invention [0005] In order to solve the deficiencies of the prior art, the disclosure provides a disambi...

AI Technical Summary

Problems solved by technology

[0004] In the existing process of word segmentation for TCM texts, the result of word segmentation is not accurate enough, especially for words with combination ambiguity, accurate word segmentation and accurate disambiguation cannot be achieved, resulting in unsatisfactory word segmentation results

Images