Decentralized Federated Learning via Random Walk Graph

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Federated learning techniques face challenges in securely and privately training machine learning models, especially for security-sensitive and privacy-sensitive applications, due to the risk of exposing sensitive data through shared embeddings.

Innovation Solution

A decentralized federated learning approach using a random walk over a communication graph, where client devices select peer devices to refine the machine learning model, allowing for secure and private updates without relying on a central server.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If federated learning shares embeddings across client devices, then model training utilizes diverse data, but sensitive data exposure risk increases

Engineering Contradiction:
Improvedata diversity for trainingVSAvoidsensitive data exposure risk
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts and removes embeddings from the federated learning process entirely. Instead of sharing embeddings between client devices, the system trains models independently on local data without extracting or transmitting embedding representations, thereby eliminating the vector space where sensitive information could be exposed while still achieving diverse data utilization through distributed training

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the federated learning process into completely isolated client-side training operations. Each client device trains its model independently on its own data without any sharing of model parameters, embeddings, or intermediate representations, creating segmented isolation that prevents sensitive data exposure while maintaining training diversity

Inventive Principle:
Principle #1Segmentation

2Reliability

If decentralized federated learning is implemented, then security and privacy are enhanced, but system complexity increases

Engineering Contradiction:
Improvesecurity and privacyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements self-service decentralized federated learning where each client device independently performs model training, evaluation, and decision-making without requiring complex coordination protocols, centralized servers, or intricate communication mechanisms. The system achieves enhanced security and privacy through this simple, autonomous approach where devices serve themselves without external intervention

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Instead of the conventional approach where a central server coordinates federated learning and clients report back, the patent inverts the architecture to complete decentralization where no central coordination exists. This inversion simplifies the system by eliminating the need for complex server-client communication protocols, aggregation mechanisms, and centralized control, achieving security through architectural simplicity rather than complex protective measures

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS20250190865A1Decentralized federated learning using a random walk over a communication graph
Publication Date: 2025.06.12 QUALCOMM INC
  • US20250190865A1 patent drawing
  • US20250190865A1 patent drawing
  • US20250190865A1 patent drawing

AI summary

Certain aspects of the present disclosure provide techniques and apparatus for training a machine learning model. An example method generally includes receiving, at a device, optimization parameters, parameters of a machine learning model, and optimization state values to be updated based on a local data set. Parameters of the machine learning model and the optimization state values for the optimization parameters are updated based on the local data set. A peer device is selected to refine the machine learning model based on a graph data object comprising connections between the device and a plurality of peer devices, including the peer device. The updated parameters and the updated optimization state values are sent to the selected peer device for refinement by the selected peer device.