Text classification method based on representation enhancement and fusion

Abstract

The invention relates to a text classification method based on representation enhancement and fusion. The method comprises the steps that a text classification model based on representation enhancement and fusion is constructed, and the processing steps of an input text in the text classification model based on representation enhancement and fusion are as follows: discrete characters of the inputtext are converted into continuous feature vectors in a data representation layer to obtain multiple representation vectors; adding disturbance into the representation vector in the representation enhancement layer to obtain a representation enhancement vector; further extracting and abstracting the characterization enhancement vector in the characterization abstraction layer to obtain an abstractcharacterization vector; classifying the abstract representation vectors in a classification layer to obtain output text tags; and synthesizing each output text label in the fusion layer to obtain afinal text label. The method can effectively solve the problems that in existing text multi-class classification, distribution of sample data among classes is unbalanced, and correct classification isdifficult when the number of samples in a small number of classes is insufficient.

Description

technical field [0001] The invention relates to the technical field of text classification, in particular to a text classification method based on representation enhancement and fusion. Background technique [0002] With the advent of the era of big data, the number of electronic texts has accumulated rapidly. Facing such a large amount of text data, its maintenance, management and utilization are extremely challenging. Using text classification technology, it can automatically classify unstructured data such as a large number of complex texts, which can enable users to classify and archive materials more conveniently and efficiently. [0003] Text classification refers to the process in which a computer maps a text containing information to a predetermined category or categories of topics. It is a topic that has been studied in natural language processing for many years, and it is also a classic machine learning technology. It has important applications in the fields of sy...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a text classification method based on representation enhancement and fusion, which can effectively solve the problem of unbalanced distribution of sample data among categories and difficulty in correct classification when there is a lack of samples in a few categories in the existing text multi-category classification. question

Images