Microblog text classification method and system based on high-quality topic expansion
A text classification and topic technology, applied in text database clustering/classification, unstructured text data retrieval, instruments, etc., can solve problems such as poor classification effect and achieve high accuracy
Active Publication Date: 2021-12-07
NORTHEASTERN UNIV LIAONING
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The method of the present invention effectively extracts high-quality topics, and effectively solves the disadvantage of poor classification effect caused by sparse features after being used for microblog feature expansion
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0067] In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.
[0068] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a microblog text classification method and system based on high-quality topic expansion. It is suitable for feature expansion of text in short text classification such as Weibo, and can realize effective classification of Weibo. The microblog data in the training set is used as the input of the LDA model to obtain the topic probability distribution and the word probability distribution; the highly representative topics extracted by information entropy are used to extract high-quality topics according to the similarity of the topics; the topic inference is performed on the test set microblogs; Select high-quality topic feature words to expand the features of the microblog text; use the support vector machine algorithm to classify and predict the expanded microblog text. This method is suitable for solving the problem of inaccurate expansion of text features caused by mixed topic words when using topic models to expand microblog text features.
Description
technical field [0001] The present invention relates to the technical field of text classification, in particular to a microblog text classification method and system based on high-quality topic expansion. Background technique [0002] As one of the emerging media, Weibo has a user base of hundreds of millions and occupies a leading position among Chinese social networking platforms. Microblog is easy to operate, and the content is updated quickly, so it has high research value. In the past few decades, there have been many studies on text classification, but the effect of short text classification such as Weibo has not been ideal. In view of the short length and sparse features of microblog texts, some words are filtered out after word segmentation and stop word processing, and few features are retained after feature selection again. Although this reduces the complexity of calculation, it makes the classification Therefore, in order to classify better, it is necessary to ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/35G06F40/284G06K9/62
CPCG06F40/284G06F18/2411G06F18/214
Inventor 张曦元孙福权
Owner NORTHEASTERN UNIV LIAONING