Text pair classification model training method, classification method and equipment and storage medium

Abstract

The invention provides a text pair classification model training method and device, electronic equipment and a storage medium. The method comprises the steps of performing text prediction processing on a first text sample in text pair samples through a first text prediction model to obtain a prediction result for the first text sample; based on unbiased distribution of the text to the sample data set, performing deviation analysis processing on the prediction result of the first text sample to obtain a weight of the text to the sample; performing semantic relationship classification processing on a first text sample and a second text sample in the text pair samples through a text pair classification model to obtain a classification result for the text pair samples; constructing a loss function of a text pair classification model based on the weight of the text pair sample and the classification result of the text pair sample; and updating the parameters of the text pair classification model until the loss function converges, and determining the updated parameters of the text pair classification model when the loss function converges as the parameters obtained after training.

Description

technical field [0001] The invention relates to artificial intelligence technology, in particular to a text pair classification model training method, a text pair classification method, electronic equipment and a storage medium. Background technique [0002] Artificial Intelligence (AI) is a comprehensive technology of computer science. By studying the design principles and implementation methods of various intelligent machines, the machines have the functions of perception, reasoning and decision-making. Artificial intelligence technology is a comprehensive subject that involves a wide range of fields, such as natural language processing technology and machine learning / deep learning. With the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important role. increasingly important value. [0003] The text pair classification model is one of the important applications in the field of natural language process...

AI Technical Summary

Problems solved by technology

[0004] However, due to the deviation of the text-pair data set, and the text-pair classification model mainly relies on the text-pair learning in the data set, the text-pair classification model learns the deviation of the text-pair data set, which reduces the generalization of the text-pair classification model ability

Images