Method and system for cutting index participle

Abstract

The invention discloses a segmentation index segmentation method. Including the following steps: read the character stream; identification described the character stream to identify Chinese characters and English characters, as well as an identification number or character; already identified Chinese and English characters or Digital and pre-built 1.1 tree comparison, the sub-set match words; English characters or figures generic fuzzy matching ASCII codes to determine English string or string of digital-term matching the above mentioned English words and string or digital string of words and non-recognition of characters referred to the character stream by order of ranking; The words and figures mentioned in the English string or strings of the sort described in the order of the character stream. The invention also openly segmentation Index segmentation system. The invention provides a cut-word indexing method and system can simultaneously address the precise words, a certain amount of redundant words and word-term problems, enhance the user experience.

Description

technical field [0001] The invention relates to the field of information indexing, in particular to a method and system for segmenting index words. Background technique [0002] Existing information retrieval systems have become increasingly popular, ranging from web search engines to application-specific information retrieval systems. When it is necessary to process Chinese character information, the information retrieval system will encounter the problem of how to segment words. [0003] There are many word segmentation algorithms at present, among which n-gram word segmentation is a mechanical word segmentation method that does not require a dictionary and is easy to implement. However, this word segmentation method has a large degree of redundancy and cannot solve the problem of single-character word segmentation. [0004] The binary word segmentation method is to separate any two adjacent words that appear in a sentence, and build an inverted index. For example: the ...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a method for segmenting index word segmentation, which can simultaneously solve the problems of accurate word segmentation, a certain amount of redundant words and single word segmentation, and enhance user experience

[0

Images