Suffix tree clustering method on basis of word segmentation and part-of-speech analysis

Abstract

The invention provides a suffix tree clustering method on basis of word segmentation and part-of-speech analysis. The method involves three parts, namely a document word segmenting module, a part-of-speech analyzing module and a suffix tree clustering module, accomplishes word segmentation, part-of-speech tagging, word weight calculation and essence extraction to a document, can realize dimension reduction process to an original document, reduces the complexity of the processing procedure of the suffix tree clustering method, and meanwhile, ensures the clustering accuracy.

Description

technical field [0001] The invention relates to a suffix tree clustering method based on word segmentation and part-of-speech analysis applied to search engines, and belongs to the technical field of computer science. Background technique [0002] With the continuous development of information technology, the data on the network is increasing at an alarming rate, and people's demand for network content is also increasing. Network content search has become the most widely used Internet service at present. The search engine is the main channel for network content search, and all countries are developing search engines with independent intellectual property rights, and are constantly conducting research on key technologies of search engines. [0003] The content on the Internet involves all aspects, and there is a large amount of unorganized and uncategorized information, which has caused certain difficulties for people who want to quickly obtain information on specific aspects...

AI Technical Summary

Problems solved by technology

[0005] The suffix tree clustering method still has some areas to be improved in the process of processing. For example, if the original document is too long, the computer will require more time for processing; there is a lot of redundant infor...

Images