Blockchain-Based Stochastic Gradient Descent Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current centralized databases face challenges in securely and efficiently verifying stochastic gradient descent (SGD) updates in machine learning models without revealing private data, leading to potential data compromise and lack of trust among participants.

Innovation Solution

Implementing a blockchain-based system that allows for decentralized storage and verification of SGD updates through homomorphic encryption, enabling private endorsement and consensus mechanisms without sharing raw data, ensuring data privacy and trust among participants.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If centralized database stores private data in a single location for easy management and control, then ease of operation and security control are improved, but data privacy and trust among participants deteriorate due to potential data compromise and lack of verification

Engineering Contradiction:
Improveease of management and controlVSAvoiddata privacy and trust
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent segments the centralized database into multiple decentralized nodes distributed across a blockchain network. Each node maintains a copy of the ledger, eliminating the single point of control while improving both operational ease through automated consensus mechanisms and reliability through distributed verification of SGD updates.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces homomorphic encryption as an intermediary layer that enables verification of SGD updates without revealing private data. This cryptographic mediator allows participants to verify model training integrity while maintaining data privacy, resolving the trust issue in centralized systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of substance

If centralized database minimizes data redundancy through single storing place, then data redundancy is reduced, but verification capability and trust among participants deteriorate

Engineering Contradiction:
Improvedata redundancyVSAvoidverification capability
Core Design Contradiction:
Loss of substanceVSReliability

Solution Approach 1:

The patent segments the single centralized storage into multiple distributed nodes, each holding a copy of the blockchain ledger. This segmentation creates controlled redundancy that actually improves verification capability, as multiple nodes can independently verify SGD updates, while maintaining efficient data utilization through the immutable ledger structure.

Inventive Principle:
Principle #1Segmentation

3Reliability

If blockchain system implements decentralized storage and homomorphic encryption for SGD verification, then data privacy and trust are improved, but device complexity and computational requirements worsen

Engineering Contradiction:
Improvedata privacy and trustVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements self-service mechanisms where the blockchain network automatically performs verification of SGD updates through consensus protocols, and homomorphic encryption automatically enables privacy-preserving computations. This reduces the need for complex manual verification processes and centralized trust management, thereby managing complexity through automation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the computational parameters by implementing homomorphic encryption, which allows mathematical operations on encrypted data. This parameter change enables verification without decryption, maintaining data privacy while managing computational complexity through efficient cryptographic algorithms designed for this purpose.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11475365B2Verification of stochastic gradient descent
Publication Date: 2022.10.18 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11475365B2 patent drawing
  • US11475365B2 patent drawing
  • US11475365B2 patent drawing

AI summary

An example operation includes one or more of computing, by a data owner node, updated gradients on a loss function based on a batch of private data and previous parameters of a machine learning model associated with a blockchain, encrypting, by the data owner node, update information, recording, by the data owner, the encrypted update information as a new transaction on the blockchain, and providing the update information for an audit.