Method for ordering significance of keywords in text

Abstract

The invention discloses a method for ordering significance of keywords in a text. The method comprises the steps of performing a word segmentation operation in a text firstly, and then removing stop words to obtain a keyword set of the text; then counting word frequencies of the keywords to obtain word frequency vectors corresponding to the keywords; setting punctuation marks with pausing functions as boundary endpoints of a co-occurrence window, counting co-occurrence information between word items to obtain co-occurrence arrays, and obtaining vectors of distribution conditions of co-occurrence of the keywords from the co-occurrence arrays of the keywords; processing the co-occurrence arrays of the keywords to obtain a keyword significance vector which is judged by a keyword co-occurrence relationship; then integrating the vectors of the distribution conditions of co-occurrence of the keywords from the co-occurrence arrays of the keywords with the word frequency vectors of the keywords by the keyword significance vector which is judged by the co-occurrence of the keywords to obtain a comprehensive significance of the keywords in the test; and finally, ordering the keywords according to the significance degree of the keywords obtained by calculating. According to the method, the significance of the keywords in the text is judged by using various types of information; and accuracy and reliability for judging the significance of the keywords in the text can be improved.

Description

technical field [0001] The invention relates to a method for sorting the importance of keywords in a text. The method is to comprehensively utilize the word frequency of keywords, the co-occurrence relationship between words and the distribution of word co-occurrence, and calculate the keywords in the text. Importance, to achieve the order of importance of keywords in the text. Background technique [0002] In the field of text processing, important keywords in the text are extracted, and then used to represent the text, and then continue to complete the corresponding tasks. In order to extract important keywords in the text, it is essentially necessary to sort the importance of keywords. In the case of not introducing external knowledge, there are two ways to judge the importance of keywords based on the word frequency of keywords and the co-occurrence relationship of terms: one is to judge the importance of keywords only by using the word frequency information of keywords...

AI Technical Summary

Problems solved by technology

However, the method mentioned above only uses one kind of information in the co-occurrence relationship between the word frequency of the keyword and the term, and judges the importance of the keyword in the text according to one kind of information

Obviously, this method will make the basis for judging the importance of keywords incomplete, and the credibility of the judgment results is poor.

Images