Secret Sharing for Secure Model Parameter Determination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In the context of cooperative security modeling, existing technologies face challenges in protecting data privacy while determining model parameters for data processing models, particularly when using methods like Newton's method, which can lead to non-convergence due to ill-conditioned matrices.
Innovation Solution
A secret sharing algorithm is employed to enable multiple parties to cooperatively determine model parameters without leaking each other's data, by secretly sharing products, activation functions, gradients, Hessian matrices, and inverse matrices, while using condition numbers to manage ill-conditioned matrices, allowing adaptive selection between Newton's method and gradient descent for optimization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If Newton's method is used for model parameter optimization, then convergence speed is improved, but data privacy is compromised due to exposure of Hessian matrices
Solution Approach 1:
The patent divides the Hessian matrix into multiple shares distributed among different parties. Each party holds only a portion (share) of the Hessian matrix, and no single party can reconstruct the complete Hessian matrix or derive the original data. This segmentation allows Newton's method to be applied using distributed computations while preserving data privacy, as the complete information is never exposed to any single entity.
Solution Approach 2:
The patent introduces a secret sharing mechanism as an intermediary between the data parties and the optimization process. Instead of directly sharing sensitive data or complete Hessian matrices, parties share encrypted portions through the secret sharing protocol. This intermediary layer enables collaborative computation of Newton's method while preventing direct access to private data, thus resolving the contradiction between optimization speed and privacy protection.
2Measurement precision
If complete Hessian matrices are shared for Newton's method, then optimization accuracy is improved, but communication overhead and computational complexity increase
Solution Approach 1:
The Hessian matrix is segmented into multiple shares that are distributed across parties. Each party performs computations on their local share without needing to handle the complete matrix. This segmentation reduces the computational burden on individual parties and decreases communication overhead, as only share updates need to be exchanged rather than complete matrix transmissions.
Solution Approach 2:
The patent applies partial action by having each party compute and share only the necessary portions (shares) of the Hessian matrix required for the distributed Newton's method. Rather than exchanging complete matrices, parties perform computations on their partial information and combine results through secure multiparty computation, reducing overall computational complexity while maintaining optimization accuracy.
3Reliability
If data is distributed among multiple enterprises for cooperative modeling, then model robustness is improved, but coordination difficulty increases
Solution Approach 1:
The patent segments the modeling process into distributed computations that each enterprise can perform independently on their local data. The secret sharing mechanism divides model parameters and intermediate computations into shares that remain with respective parties. This segmentation enables robust cooperative modeling across multiple enterprises while simplifying coordination, as each party follows the same protocol steps without needing complex inter-party communication or data sharing.
Solution Approach 2:
Each enterprise performs computations on their own data and shares using their own computational resources. The distributed Newton's method allows parties to independently compute gradients and Hessian shares from their local data, then combine results through standardized secret sharing operations. This self-service approach improves model robustness through diverse data contributions while reducing coordination difficulty, as enterprises autonomously execute their portion of the workflow.
Data Source
AI summary
Implementations of the present specification provide method for determining a new model parameter for a data processing model. The method includes determining and receiving, from one or more other data parties, one or more other shares of a new model parameter. The one or more other shares of the new model parameter can be combined with a first share of the new model parameter determined by a first data party to produce a new model parameter. The new model parameter is used to train the data processing model.


