Model training method and device based on privacy data set

Abstract

The invention relates to the technical field of multi-party data cooperation, and provides a model training method and device based on a privacy data set. The method comprises the following steps: training a server-side model based on a public data set and a real label corresponding to the public data set; obtaining a first model output sent by each client, wherein the first model output is obtained by inputting the public data set into the local learning model, and the local learning model is obtained based on the privacy data set and corresponding label training; training a server side model based on the corresponding public data output by each first model; inputting the public data set into the server-side model to obtain a second model output; and sending the second model output to each client, so that each client performs retraining of the local learning model based on the second model output and the public data set. Therefore, on the premise of avoiding leakage of the privacy data set, model training is carried out by taking the privacy data set as a part of training samples based on knowledge distillation and knowledge fusion.

Description

technical field [0001] The present invention relates to the technical field of multi-party data cooperation, in particular to a model training method and device based on private data sets. Background technique [0002] In data analysis, data mining, economic forecasting and other fields, machine learning models can be used to analyze and discover potential data value. Since the data held by a single data owner may be incomplete, it is difficult to accurately describe the target. In order to obtain better model prediction results, the joint training of the model is carried out through the data cooperation of multiple data owners. has been widely used. However, in the process of multi-party data cooperation, issues such as data security and model security are involved. [0003] Especially in the medical field, some data sets involve privacy and cannot be made public, and can only be used within the hospital. It is very difficult to build a learning model based on the privat...

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a model training method and device based on private data sets to solve the problem of lack of model training solutions based on multi-party private data sets

Images