Federated Learning for Distributed Medical Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Hospitals face inefficiencies in sharing pertinent patient medical data, particularly for improving neural networks, due to geographical barriers and existing data sharing challenges.

Innovation Solution

A distributed medical network system that trains machine learning models hosted by local hospitals, involving data input, loss generation, parameter gradient calculation, global update generation, and model updating across multiple local computers, facilitating efficient data sharing and model enhancement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If hospitals share patient medical data across geographical locations, then model training effectiveness is improved, but data privacy and security risks increase

Engineering Contradiction:
Improvemodel training effectivenessVSAvoiddata privacy and security risks
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

A central server acts as an intermediary that coordinates federated learning across multiple hospitals. The server aggregates local parameter gradients from each hospital's machine learning models without directly accessing or storing the actual patient medical data, enabling collaborative model training while maintaining data privacy and security at each local institution.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If hospitals train machine learning models locally with their own data, then data privacy is maintained, but model performance and generalization capability deteriorate

Engineering Contradiction:
Improvedata privacy protectionVSAvoidmodel performance
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The training process is segmented into local and global components. Each hospital trains its local machine learning model independently on its own patient data, maintaining data privacy. The local parameter gradients from each segmented training process are then aggregated at a central server to achieve global model improvement, combining the benefits of local data control with collaborative learning.

Inventive Principle:
Principle #1Segmentation

3Productivity

If patient medical data is centralized for training, then model training efficiency is improved, but data transmission time and network bandwidth requirements increase

Engineering Contradiction:
Improvemodel training efficiencyVSAvoiddata transmission time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent extracts only the essential information needed for model training—the parameter gradients—from each hospital's local data, rather than transmitting the actual patient medical data. This extraction approach maintains model training efficiency by providing sufficient training signals while dramatically reducing data transmission time and network bandwidth requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

4Productivity

If federated learning is implemented across multiple hospitals, then data sharing efficiency is improved, but system complexity and coordination overhead increase

Engineering Contradiction:
Improvedata sharing efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The central server provides universal coordination functionality for the federated learning system, handling multiple tasks including aggregation of parameter gradients, management of model versions, and coordination of training schedules across all participating hospitals. This multi-functional approach simplifies the overall system architecture by consolidating coordination complexity in a single universal component.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11379727B2Systems and methods for enhancing a distributed medical network
Publication Date: 2022.07.05 SHANGHAI UNITED IMAGING INTELLIGENCE CO LTD
  • US11379727B2 patent drawing
  • US11379727B2 patent drawing
  • US11379727B2 patent drawing

AI summary

Methods and systems for enhancing a distributed medical network. For example, a computer-implemented method includes inputting training data corresponding to each local computer into their corresponding machine learning model; generating a plurality of local losses including generating a local loss for each machine learning model based at least in part on the corresponding training data; generating a plurality of local parameter gradients including generating a local parameter gradient for each machine learning model based at least in part on the corresponding local loss; generating a global parameter update based at least in part on the plurality of local parameter gradients; and updating each machine learning model hosted at each local computer of the plurality of local computers by at least updating their corresponding active parameter set based at least in part on the global parameter update.