Secret Sharing for Secure Model Parameter Determination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the context of cooperative security modeling, existing technologies face challenges in protecting data privacy while determining model parameters for data processing models, particularly when using methods like Newton's method, which can lead to non-convergence due to ill-conditioned matrices.

Innovation Solution

A secret sharing algorithm is employed to enable multiple parties to cooperatively determine model parameters without leaking each other's data, by secretly sharing products, activation functions, gradients, Hessian matrices, and inverse matrices, while using condition numbers to manage ill-conditioned matrices, allowing adaptive selection between Newton's method and gradient descent for optimization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If Newton's method is used for model parameter optimization, then convergence speed is improved, but data privacy is compromised due to exposure of Hessian matrices

Engineering Contradiction:
Improveconvergence speedVSAvoiddata privacy
Core Design Contradiction:
SpeedVSLoss of information

Solution Approach 1:

The patent divides the Hessian matrix into multiple shares distributed among different parties. Each party holds only a portion (share) of the Hessian matrix, and no single party can reconstruct the complete Hessian matrix or derive the original data. This segmentation allows Newton's method to be applied using distributed computations while preserving data privacy, as the complete information is never exposed to any single entity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a secret sharing mechanism as an intermediary between the data parties and the optimization process. Instead of directly sharing sensitive data or complete Hessian matrices, parties share encrypted portions through the secret sharing protocol. This intermediary layer enables collaborative computation of Newton's method while preventing direct access to private data, thus resolving the contradiction between optimization speed and privacy protection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If complete Hessian matrices are shared for Newton's method, then optimization accuracy is improved, but communication overhead and computational complexity increase

Engineering Contradiction:
Improveoptimization accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The Hessian matrix is segmented into multiple shares that are distributed across parties. Each party performs computations on their local share without needing to handle the complete matrix. This segmentation reduces the computational burden on individual parties and decreases communication overhead, as only share updates need to be exchanged rather than complete matrix transmissions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by having each party compute and share only the necessary portions (shares) of the Hessian matrix required for the distributed Newton's method. Rather than exchanging complete matrices, parties perform computations on their partial information and combine results through secure multiparty computation, reducing overall computational complexity while maintaining optimization accuracy.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If data is distributed among multiple enterprises for cooperative modeling, then model robustness is improved, but coordination difficulty increases

Engineering Contradiction:
Improvemodel robustnessVSAvoidcoordination difficulty
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments the modeling process into distributed computations that each enterprise can perform independently on their local data. The secret sharing mechanism divides model parameters and intermediate computations into shares that remain with respective parties. This segmentation enables robust cooperative modeling across multiple enterprises while simplifying coordination, as each party follows the same protocol steps without needing complex inter-party communication or data sharing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each enterprise performs computations on their own data and shares using their own computational resources. The distributed Newton's method allows parties to independently compute gradients and Hessian shares from their local data, then combine results through standardized secret sharing operations. This self-service approach improves model robustness through diverse data contributions while reducing coordination difficulty, as enterprises autonomously execute their portion of the workflow.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10803184B2Generation of a model parameter
Publication Date: 2020.10.13 ADVANCED NEW TECHNOLOGIES CO LTD
  • US10803184B2 patent drawing
  • US10803184B2 patent drawing
  • US10803184B2 patent drawing

AI summary

Implementations of the present specification provide method for determining a new model parameter for a data processing model. The method includes determining and receiving, from one or more other data parties, one or more other shares of a new model parameter. The one or more other shares of the new model parameter can be combined with a first share of the new model parameter determined by a first data party to produce a new model parameter. The new model parameter is used to train the data processing model.