Inferring emerging and evolving topics in streaming text

Abstract

A method, system and computer program product for inferring topic evolution and emergence in a set of documents. In one embodiment, the method comprises forming a group of matrices using text in the documents, and analyzing these matrices to identify evolving topics and emerging topics. The matrices includes a matrix X identifying a multitude of words in each of the documents, a matrix W identifying a multitude of topics in each of the documents, and a matrix H identifying a multitude of words for each of the multitude of topics. These matrices are analyzed to identify the evolving and emerging topics. In an embodiment, two forms of temporal regularizers are used to help identify the evolving and emerging topics. In another embodiment, a two stage approach involving detection and clustering is used to help identify the evolving and emerging topics.

Description

CROSS REFERENCE TO RELATED APPLICATION[0001]This application is a continuation of copending U.S. patent application Ser. No. 13 / 315,798, filed Dec. 9, 2011, the entire content and disclosure of which is hereby incorporated herein by reference.BACKGROUND OF THE INVENTION[0002]The present invention generally relates to document analysis, and more specifically, to inferring topic evolution and emergence in streaming documents.[0003]Learning a dictionary of basis elements with the objective of building compact data representations is a problem of fundamental importance in statistics, machine learning and signal processing. In many settings, data points appear as a stream of high dimensional feature vectors. Streaming datasets present new twists to the problem. On one hand, basis elements need to be dynamically adapted to the statistics of incoming datapoints, while on the other hand, many applications require early detection of rising new trends. The analysis of social media streams for...

AI Technical Summary

Benefits of technology

[0015]In one embodiment of the invention, given streaming matrices, a sequence of NMFs is learned with two forms of temporal regularization. The first regularizer enforces smooth evolution of topics via constraints on amount of drift allowed. The second regularizer applies to an additional “topic bandwidth” introduced into the system for early detection of emerging trends. Implicitly, this regularizer extracts smooth trends of candidate emerging topics and then encourages the discovery of those that are rapidly growing over a short time window. This setup is formulated as an objective function which reduces to rank-one subproblems involving projections onto the probability simplex and SVM-like optimization with additional non-negativity constraints. Embodiments of the invention provide efficient algorithms for finding stationary points of this objective function. Since they mainly involve matrix-vector operations and linear-time subroutines, these algorithms scale gracefully to large datasets.

Problems solved by technology

Streaming datasets present new twists to the problem.

Consider the problem of building compact, dynamic representations of streaming datasets such as those that arise in social media.

Each new batch of documents arriving at a timepoint is completely unorganized and may contribute either to ongoing unknown topics of discussion (potentially causing underlying topics to drift over time) and / or initiate new themes that may or may not become significant going forward, and / or simply inject irrelevant “noise”.

Images