Chinese word cutting method and device

Abstract

The invention discloses a Chinese word segmentation method. Including: the sub-term participant weights, the word referred to the sub-set of words in the sentence in accordance with the terms of the location of sorting. The words from the set the last word at the beginning, the current record-term value of the right word to the previous sentence at the end of the distance. As the current term to the end of the sentence at the distance, marking the first word segmentation and segmentation of the current relations between the stitching until the words are set in the first term to the end of the sentence at the distance. And the word referred to a sub-section with the words of the former sub-stitching; points from the word referred to a sub-set of words, referred to choose The shortest distance between the end of the sentence the word at the first sentence, the word referred to the first sentence of the first word of the sentence referred to the first word from the first sentence referred to the words,, in accordance with Mosaic, followed by access splicing relations marked by the first-term until the end of the sentence. The present invention also open a Chinese word segmentation devices. The above methods or devices reduces the complexity.

Description

technical field [0001] The invention relates to the field of Chinese information processing, in particular to a Chinese word segmentation method and device used in the field of Chinese information processing. Background technique [0002] For Chinese, the smallest, independently active, and meaningful language component is a word. A word is composed of a single or multiple characters. Generally, two-character words are the most used, followed by single-character words, and there are also some multi-character words. Words (such as idioms, proper nouns, etc.). However, Chinese uses characters as the basic unit of writing, and there is no such symbol as English spaces between words to identify word boundaries. Therefore, to segment each sentence in the Chinese text, that is, the machine automatically recognizes the words in the sentence Word boundary is the first problem to be solved in Chinese text analysis and processing. [0003] At present, commonly used word segmentation...

AI Technical Summary

Problems solved by technology

[0018] From the above analysis, it can be known that the existing shortest path word segmentation method needs to convert the original word segmentation set obtained from the dictionary into the form of a directed acyclic graph, and needs to call the algorithm for solving the shortest path, which makes the word segmentation process more complicated and inconvenient accomplish

Images