Public opinion hot word finding method based on keyword weighting algorithm

Abstract

The invention discloses a hot word finding method, and particularly relates to a public opinion hot word finding method based on a keyword weighting algorithm. According to the public opinion hot word finding method based on the keyword weighting algorithm, a Chinese word segmentation tool is utilized to conduct preliminary word segmentation on massive public opinion information, part-of-speech tagging is provided, an IDF table, a filter word table and a part-of-speech weighting value table are combined at the same time, according to a weighting type TF-IDF algorithm, a candidate word popularity value is calculated, the calculation is not only relied on word frequency, instead, effective information contained in part-of-speech, position and the like of a word is taken into full account, and reliability basis is provided for hot word recognition. In addition, in the public opinion hot word finding method based on the keyword weighting algorithm, the characteristic that the public opinion has a distinct topic and theme under a we media time is taken into full account, corpus processing is mainly conducted on the public opinion topic, and the problem of the efficiency of the hot word recognition under massive public opinion information is solved. Finally, dynamic incremental type updating is achieved for the IDF table, the real-time performance of the word inverse document frequency is guaranteed, and the accuracy of the hot word recognition is improved.

Description

technical field [0001] The invention relates to a hot word discovery method, in particular to a hot word discovery method based on a keyword weighting algorithm. technical background [0002] With the popularization and rapid development of the Internet, a large amount of news data emerges on the Internet every day. On the other hand, the emergence of self-media such as microblogs, blogs, and forums has transformed the publishers of information on the Internet from professional news media reporters into ordinary netizens of all walks of life, and the general public has also changed from passive information receivers in the past to current ones. Disseminator of information. As a result, Internet terms have become more and more colorful, such as "Gili", "Diaosi", "Lie Gun" and other new words emerging one after another. Under such circumstances, how to mine hot words in the complicated network information, how to obtain popular new entries and new concepts, and then effectiv...

AI Technical Summary

Problems solved by technology

[0018] The present invention mainly solves the problems and deficiencies of the existing hot word discovery methods in the self-media era, and provides a hot word discovery method based on the keyword weighted TF-IDF algorithm to solve the problem of hot word discovery under massive public opinion information. Efficiency and accuracy issues, so as to achieve efficient and accurate identification of hot words

Images