Hot topic extraction method and device, computer equipment and storage medium

Abstract

The invention relates to the field of big data processing, and discloses a hot topic extraction method and device, computer equipment and a storage medium, and the method comprises the following steps: obtaining text data; performing data preprocessing on the text data, and removing noise data in the text data to obtain candidate text data; performing syntactic structure classification on the candidate text data, and combining the classified candidate text data according to syntactic structure features to generate a sentence text; extracting core components in the sentence text based on a deep semantic learning model, then generating hot short sentences, outputting the hot short sentences, wherein the hot short sentences are used for describing hot topics. The hot topics can be recognized from a large amount of text data, the extraction efficiency of the hot topics is improved, the hot topics are described through the simplified hot short sentences, the semantic information content of the hot topics is richer, and the information reading efficiency of the hot topics is improved.

Description

technical field [0001] The present application relates to the field of big data, in particular to a hot topic extraction method, device, computer equipment and storage medium. Background technique [0002] In the era of information explosion, the amount of daily public opinion information is at the level of millions, even tens of millions, or hundreds of millions. Users often need to spend a lot of time identifying hot information in public opinion information, so users hope to quickly browse the hot core information of public opinion information However, there is currently a lack of automatic technical solutions for extracting hot topics of public opinion. At present, most of the hot topics of public opinion are manually set, for example, represented by #XXX#, where XXX identifies the content of the hot topic, so when the hot topic appears , Generally, each platform manually summarizes and compiles hot topics. The automation of hot topic extraction is low, and the coverage ...

Images