Method for automatically creating keyword index table

Abstract

The invention discloses a method for automatically creating a keyword index table. The method includes subjecting a file to be translated to word segmentation process to obtain a word list of the file, and subjecting the word list to part-of-speech tagging; filtering candidate keywords in the word list to obtain a coarse candidate word collection and codes of each sense of the candidate keywords; subjecting the candidate keywords to synonym chain construction according to semantic similarity of the words to obtain a synonym chain collection; acquiring word weight of vocabularies in the synonym chain collection and extracting keywords to form a keyword collection according to the word weight; and comparing the keyword collection with an existing reference library keyword index collection, providing a relevant file collection if the existing reference library keyword index collection contains the candidate keywords, otherwise, adding the candidate keywords to the reference library keyword index collection, and simultaneously, creating an index. Compared with traditional keyword extraction methods, the method has the advantages that precision rates and recall rates are obviously increased.

Description

technical field [0001] The invention relates to a computer technology, in particular to a method for automatically establishing a keyword index table. Background technique [0002] Keywords are used to characterize the important information and core content of the document, which is convenient for obtaining the abstract information of the document and retrieving the specific document. Traditional keyword extraction generally adopts manual extraction, and manual keyword extraction is very time-consuming. With the sharp increase in the number of documents, manual keyword extraction is increasingly unable to meet the needs of practical applications. Therefore, how to automatically extract keywords is a hot and difficult point in document retrieval research. [0003] Keyword extraction is a basic research problem in the field of text mining. Many text mining systems use the sentence where the keyword is located as the abstract sentence. Most clustering and classification algori...

AI Technical Summary

Problems solved by technology

[0008] The above two types of methods extract keywords from the frequency or rules, without taking into account the semantics, parts of speech and other information of the words, and the accuracy is relatively low

Images