The application relates to a GPU-based high-performance multi-party secure computation training method and
system, and particularly relates to the field of multi-party secure computation protocols.The application aims to provide a multi-party secure computation training framework with higher parallelism, so as to realize parallelism between different
layers of a neural network in a manner of combining
data parallelism and model parallelism, and improve the data
throughput speed of a training process.The method is a multi-party secure computation training
system based on a pipeline flow training method, as shown in Figure 1, the method is designed according to the characteristics that the bottlenecks of linear computation network
layers and nonlinear computation network
layers in the MPC model training process are calculation and communication respectively, a pipeline flow training method is designed, parallelism between sub-networks is realized, and an optimal sub-
network segmentation algorithm is realized to balance the
training load between each sub-network.The application provides a multi-party secure computation training framework with higher parallelism, parallelism between different layers of a neural network is realized in a manner of combining
data parallelism and model parallelism, and the data
throughput speed of a training process is greatly improved.