Event detection method based on Twitter

Abstract

The invention discloses an event detection method based on Twitter, used to solve the real-time problem of news clue acquisition in the prior art. The event detection method based on the Twitter comprises the following steps: pre-treating tweets by using the natural language processing technology; performing online clustering on the tweets based on short text similarity; performing preliminary judgment on the event attributes of a tweet cluster by means of the characteristics of the tweets in each tweet class; and judging whether the detected event is a first event or not by means of the existing tweet event library, so as to prevent the event from repeating output. The event detection method based on the Twitter has low computational complexity and can be used for detection of sudden hotevents in large-scale flow data; and the event detection method based on the Twitter helps to obtain valuable information from a social media faster and more accurately, and can produce economic benefits directly or indirectly.

Description

technical field [0001] The invention belongs to the field of data mining, in particular to a Twitter-based data mining technology. Background technique [0002] With the advent of the web 2.0 era, Internet users are more and more actively acquiring network content and participating in the creation of content, one of which is based on social media. As the name suggests, social media is used for social networking. With the growth of social users, one or multiple overlapping social networks are gradually formed inside, and social information can be spread among users along the network. Generally speaking, social media users can directly obtain the social information sent by the users they follow. From the perspective of graph theory, they can obtain information from adjacent users. Although the social network structure is very complex, according to the theory of six degrees of separation, its diameter will not be too large. Therefore, through forwarding by social users, inform...

AI Technical Summary

Problems solved by technology

[0006] Traditional news organizations generally obtain news clues and release news manually. Although this can guarantee the quality of news, the real-time performance of news will be greatly affected.

Images