A short text classification method based on semantic enhancement and multi-level label embedding

Abstract

The invention discloses a short text classification method based on semantic enhancement and multi-level label embedding. First, on the basis of pre-training a multi-layer language model to obtain character-level embedding representations, the traditional word embedding method is used to embed word semantics into character-level In the text representation; secondly, the local and sequence information of the text is used as the multi-dimensional feature representation of the sentence; finally, a multi-level label embedding is proposed, and the fast and accurate classification of short text data is realized through the Softmax function. The present invention uses the traditional text representation method to expand the text encoding information of the pre-training model, and solves the problem of insufficient semantic expression of the word embedding module; cooperates with the multi-scale CNN and bidirectional GRU modules to enhance the advanced and deep semantic representation of the text, and strengthen the text encoding of short texts , replace the traditional one-hot label representation, vectorize the classification label, use the semantic information contained in it, filter the text representation and assist classification decision-making at the word level and sentence level respectively, and improve the performance of short text classification.

Description

【Technical field】 [0001] The invention belongs to the technical field of machine learning and data mining, and relates to a short text classification method based on semantic enhancement and multi-level label embedding. 【Background technique】 [0002] With the rapid development of social media and the rapid increase of network user groups, the network is full of comments from netizens and is growing at an explosive speed. However, due to the limitation of text input in social media, most of these comments are presented in the form of short texts, such as product reviews, questions raised by users in the Q&A system, and updates posted by users in Weibo. Quickly extracting valuable information from massive data requires basic and effective data management, namely short text classification. In addition, short text classification has also become the basis for many fields such as automatic question answering, text retrieval, topic tracking and search engines. Sexual technology h...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the problem of poor performance of text classification in the prior art, and provide a short text classification method based on semantic enhancement and multi-level label embedding

Images