Backward word segmentation method and device based on Chinese retrieval

Abstract

The invention provides a backward word segmentation method and device based on Chinese retrieval and relates to the field of processing of webpage character information in computer networks. According to the backward word segmentation method and device based on the Chinese retrieval, professional word banks are established in a robot dictionary, the value of the MAX_Length is determined firstly according to the maximum lengths of proper nouns in the word banks, a backward matching algorithm is formed through a backward maximum matching algorithm, and in order to solve the problems of word segmentation ambiguity and incomplete matching during backward matching, a maximum length matching algorithm is improved. According to the backward word segmentation method and device based on the Chinese retrieval, word segmentation is carried out on a Chinese character string which is S=C1C2C3C4...Cn through the device which is composed of a central processing unit, input-and-output equipment, a register, a mechanized dictionary, a window counter and a memorizer, accuracy segmentation of Chinese character strings can be achieved on the premise that the semantic of the Chinese character strings is not lost, a word segmentation result is quite accurate when a sentence is quite long, and searching accuracy can be improved. The backward word segmentation method and device based on the Chinese retrieval can be applied to an automatic abstracting and sorting system in the field of information retrieval.

Description

technical field [0001] The invention relates to the field of text information processing of webpages in computer networks, in particular to a method and device for retrieving Chinese webpages in search engines. Background technique [0002] With the continuous development of the Internet, the number of web pages has increased dramatically, and web pages have become the largest and most extensive source of information for people. A lot of useful information is submerged in the vast number of Web pages. Faced with massive information, people can no longer simply rely on manual processing of all the information. Text search is one of the important application technologies in the field of large-scale information processing, and it is also an important research direction in the field of information processing. With the in-depth study of text classification search technology, text search technology is more and more widely used in information technology. The word segmentation tec...

AI Technical Summary

Problems solved by technology

[0017] The present invention aims at the problems existing in the single reverse maximum matching algorithm. In the search system, especially the vertical search system, the professional environment is fully utilized to establish a professional thesaurus in the machine dictionary. The maximum length is used to determine the value of MAX_Length, which solves the problem of blindly selecting the maximum length in the matching algorithm, and forms a reverse matching algorithm by combining the reverse maximum matching algorithm, which greatly improves the accuracy of retrieval

Images