An Online Short Text Data Stream Classification Method Based on Feature Expansion

Abstract

The invention discloses an online short text data stream classification method based on feature expansion, the steps of which include: 1 constructing a Word2vec model according to an external corpus, and obtaining a word vector set Vec; 2 using Vec to vectorize the short text data stream and performing Text vectorization extension; 3 pairs of extended text vectors to build an online deep learning network; 4 pairs of neurons in the LSTM network to introduce concept drift semaphores and detect changes in the distribution of short text streams; 5 Complete the online deep learning network model update and short text Prediction of this data stream. The invention can effectively improve the classification accuracy rate of the short text data flow, correctly detect concept drift and adjust the model, thereby achieving the purpose of quickly adapting to the environment of the short text data flow.

Description

technical field [0001] The invention belongs to the field of practical application to short text data flow mining and online deep learning, and in particular relates to the classification problem of constantly changing, fast and infinite short text data flow. Background technique [0002] With the rise of information technology such as mobile development and micro-service framework, a kind of massive, high-speed and dynamic data-data flow has emerged in practical application areas such as social networking, online shopping, and sensor networks. In the social field, due to the popularity of social network media and forums, very short texts flood into our lives, such as Weibo, tweets, Facebook and other user comments and interactions on forums. Short essays contain a lot of information in various fields such as sports, education, science, etc. Compared with ordinary texts, short texts are sparse, real-time, massive, irregular, and dynamic, which leads to thematic evolution. ...

AI Technical Summary

Problems solved by technology

[0003] One of the challenges: Traditional short text classification due to the high-dimensional sparseness of short texts makes traditional text classification techniques difficult to be effective; the current solution: one is to use external corpora to expand short texts, and then use traditional classification methods for classification , such as Naive Bayes Bayes), support vector machine (SVM), decision tree and other classifiers; one is to use its own hidden statistical information to expand short text for short text classification, such as LDA, KNN, etc.

However, the stability of these models is greatly affected by the integrity of the external corpus, resulting in poor portability and stability of the model.

[0004] Challenge 2: Due to the massive and infinite nature of continuous data, traditional multi-iterative deep learning frameworks based on static data sets (such as Text-CNN, RNN, etc.) cannot handle continuous data well, and the model cannot obtain better performance

[0005] Challenge 3: Short text streams have characteristics such as dynamic changes. Due to the limitation of the static framework of the network layer, the current mainstream deep learning framework cannot quickly adapt to changing data streams, resulting in the inability of traditional neural network models to process short texts well. dynamics of book

Images