Text classification model training method and device, equipment and readable medium

Abstract

The embodiment of the invention is applied to the field of artificial intelligence, and discloses a text classification model training method and device, equipment and a readable medium, and the method comprises the steps: obtaining a labeled sample set and a non-labeled sample set of a classification model; performing text enhancement processing on the second text data in the unmarked sample set to obtain enhanced text data; inputting the labeled sample set, the unlabeled sample set and the enhanced text data into a classification model; training the classification model according to a first loss function determined by the predicted first probability distribution of each piece of first text data in the labeled sample set, the predicted second probability distribution of each piece of second text data and the predicted third probability distribution of the enhanced text data, the labeled sample set and the unlabeled sample set; and when the first loss function meets a training ending condition, determining a target text classification model. By adopting the embodiment of the invention, the model training efficiency can be improved, and the service iteration speed can be improved. The invention relates to the blockchain technology. The data can be stored in a blockchain.

Description

technical field [0001] The present invention relates to the field of artificial intelligence, in particular to a text classification model training method, device, equipment and readable medium. Background technique [0002] With the growth of text information, text classification has become a key technology for processing text information and has been widely used in various fields. For example, in the field of human-computer dialogue, computer equipment can receive query sentences spoken by users, classify the text information corresponding to the query sentences, and after determining the classification corresponding to the text information, automatically classify the user query sentences according to the corresponding classification. To answer, and can push relevant information and so on. At present, among the methods for classifying text information, the most common method is to make predictions through trained deep learning models. Among them, training deep learning m...

AI Technical Summary

Problems solved by technology

However, the efficiency of manually labeling a large amount of corpus is low, resulting in slow business iteration

Images